Assignment Description

We are seeking a highly skilled and experienced Data Engineer with a strong background in AWS  to our client, to contribute to the buildup of their new global data analytics platform for data scientists. In the role as Data Engineer, you will be responsible for developing the architecture and designing of their planned environment.

Key deliverables:

• Design and implement a robust and scalable environment in AWS using best practices whenever applicable.
• Design, develop, scalable and robust data pipeline architecture for data ingestion, transformation, and integrations.
• Support users-scientist with tooling such as: Sage Maker, Redshift, Athena ….
• Implement data solutions to enable real-time and batch data processing, ensuring data quality, accuracy, and consistency across multiple sources.
• Collaborate with user such as data scientists, analysts, and other stakeholders to understand and address data requirements for various analytical and operational needs.
• Work closely and align with ITOps to build a robust and secure data governance model.
• Model, design for optimized data processing performance, ensuring efficient use of resources and adherence to best practices.
• Troubleshoot and resolve data-related issues, providing technical guidance and support to team members and stakeholders during the project.
• Contribute with up-to-date industry standards, trends, and advancements in the data engineering field, applying new techniques and technologies as appropriate.

Requirements:

• Minimum of 5 years of experience in data engineering or a similar role.
• Strong hands-on experience with AWS services such as S3, Glue, Lambda, EMR, and Redshift.
• Hands-on experience from architectural design in AWS
• Familiarity with data modelling, data warehousing, and big data technologies.
• Experienced in Data Visualization Tools