Assignment description

We are looking for an experienced Azure Databricks Data Engineer to work with development and delivery of production-grade data platforms. The role requires strong expertise in Databricks engineering and modern data platform solutions.

Qualifications

• You have strong experience in Azure Databricks engineering and delivering production-grade data platforms.
• You have advanced Apache Spark skills, including PySpark/Scala, Spark SQL, and strong expertise in Delta Lake, including ACID transactions, partitioning, schema evolution, OPTIMIZE/ZORDER, and incremental/CDC patterns.
• You have experience building scalable batch and streaming pipelines using bronze/silver/gold architectures and reusable transformation frameworks.
• You have strong knowledge of governance and security, including Unity Catalog permissions, service principals/managed identities, lineage, and auditability in multi-team environments.
• You have experience with Spark performance tuning, observability, Azure integrations (ADLS, ADF/Synapse, Key Vault, Entra ID), and CI/CD practices using Azure DevOps/GitHub Actions. Experience with Databricks Asset Bundles or Terraform is considered an advantage.

Nice to have

• You have a Databricks Certified Data Engineer Associate or Professional certification.