Assignment Description

Our client in the automotive industry is currently seeking a Senior Data Engineer. As a Senior Data Engineer, you’ll be part of a specialized team that emphasizes cloud cost analysis and data management across Azure and AWS platforms. Within their agile framework, you’ll champion best practices in analytics and cloud optimization.

Our client is committed to enriching lives through digital innovation and world-class automotive solutions. If you’re an experienced data professional who’s passionate about cloud technologies, then you are the missing piece in their journey to revolutionize the Public Cloud Enablement Product.

Requirements:

• Sophisticated Cost Analysis: Utilize your Power BI, R, SQL, and business intelligence expertise to conduct complex cost assessments across Azure and AWS platforms, identifying trends and anomalies.
• Data Pipeline Development: Design and implement robust data pipelines that enable seamless data flow and analytics.
• Cross-Platform Integrations: Develop and manage integrations between various applications like Snowflake, ServiceNow, Azure, and AWS.
• API Interactions: Work on API endpoints to fetch and return data, ensuring smooth and secure data transactions.
• Complex Business Logic: Create and implement advanced business logic to solve intricate problems and optimize cloud-based solutions.
• Alerts and Automation: Develop automated alerts and triggers that send emails based on specified thresholds for cloud costs, system performance, or other KPIs.
• UI Attention: Maintain a strong focus on user interface details, ensuring a seamless and user-friendly experience.
• Strategic Cost Allocation: Leverage your proficiency in advanced query scripting to create and implement cost-distribution models across different organizational units like departments and projects.
• Efficient Cost Optimization: Use your deep insight into Azure and AWS platforms and system architectures to provide data-backed recommendations for optimizing cloud expenditure and scalability.
• Synergizing Infrastructure and Cost: Partner with their cloud engineering team to apply your coding skills in Python, SQL, and Scala, to evaluate how infrastructure decisions impact cloud costs.
• Executive Reporting: Use Power BI to craft comprehensible and thorough reports for upper management, highlighting actionable avenues for cloud cost reduction.
• Continuous Learning and Adaptation: Keep yourself updated with the latest advancements in Azure, AWS, and Power BI to ensure they benefit from emerging cost-saving features and approaches.
• Stakeholder Engagement: Utilize your excellent communication skills to liaise with stakeholders across various departments, helping them understand their cloud consumption patterns and identify cost-saving opportunities.
• Educational Outreach: Leverage your deep understanding of cloud cost management to conduct instructional sessions that help internal teams optimize cloud costs and resource utilization.

Qualifications:

• Bachelor’s degree in Computer Science or a related field.
• Minimum of 4 years’ experience in business intelligence with a strong focus on Power BI.
• At least 6 years of experience in writing complex queries, proficient in R and SQL.
• 6+ years of experience in software engineering, specifically in coding languages like Python, SQL, and Scala.
• Proven experience in designing and implementing data pipelines.
• Expertise in API development and management.
• Strong skills in creating automated alerts and triggers based on specific thresholds.
• Experience with cross-platform integrations involving applications like Snowflake, ServiceNow, Azure, and AWS.
• Mastery in linking and integrating multiple data sources.
• Proficient in Azure and AWS cost analysis tools.
• Deep understanding of system architecture and design including patterns, reliability, scalability, and user interface details.
• Aptitude for clearly communicating complex data insights to both technical and non-technical stakeholders.
• Solid understanding of cloud infrastructure and associated costs.

Desired Attributes:

• Strong problem-solving abilities.
• Strategic thinker capable of evaluating priorities and making informed decisions.
• A commitment to continuous learning and a talent for identifying cost-saving opportunities.
• Quick prototyping skills and exceptional analytical abilities.