Assignment description
Our client is searching for a Tech Lead – Data Engineer. With this role you will need 10-12 years of experience in the space of Data Engineering where at least 4 year’s or more of work experience.
Requirements and skills needed:
- Data Engineer on modern Cloud Data Platforms /or advanced analytics environments
- Software Engineer with Cloud technologies and infrastructure
- Experience in different data formats (Avro, Parquet)
- Experience in data query languages (SQL or similar)
- Centric programming using one of more programming languages Python, Java /or Scala. Python
- Good understanding of different data modelling techniques and trade-offs
- Knowledge of NoSQL and RDBMS databases
- Experience in GCP tools – Dataflow, Dataproc and Bigquery
- Experience in data processing framework – Beam, Spark, Hive, Flink
- Take end-to-end responsibility to build, optimize and support of existing and new data products towards the defined target vision
- Be a champion of DevOps mindset and principles and able to manage CI/CD pipelines and terraform as well as Cloud infrastructure, in our context, it is GCP (Google Cloud Platform)
- Understanding data security principles, implementing role-based access controls, and adhering to data governance policies when working with sensitive information
- Have a collaborative and co-creative mindset with excellent communication skills
- Motivated to work in an environment that allows you to work and take decisions independently
- Fluent in English, both written and verbal
- Previous demonstrated experience in building retail customer segmentation is a plus
