Senior Data Engineer

About the role

We are seeking a Senior Data Engineer to design, build and maintain scalable data pipelines on the Databricks Lakehouse Platform. The role combines hands‑on development with collaboration across business units to deliver actionable insights.

Key responsibilities

• Build and maintain batch and streaming pipelines on Databricks using Delta Live Tables and Structured Streaming.
• Develop ETL/ELT processes with SQL and Python, implementing the Medallion Architecture (Bronze, Silver, Gold).
• Design and optimise data models, including star‑schema and dimensional models.
• Create interactive dashboards and analytics using Databricks SQL.
• Monitor, troubleshoot and optimise pipeline performance and reliability.
• Implement data governance with Unity Catalog and Delta Lake.
• Collaborate with cross‑functional teams to define KPIs and deliver business insights.
• Mentor junior engineers and follow best practices such as Git version control and CI/CD pipelines.

Required profile

• 4+ years of experience in data engineering or data analytics.
• Strong expertise in SQL (CTEs, window functions, query optimisation).
• Proficient in Python programming.
• Hands‑on experience with Databricks Lakehouse, Delta Lake and Medallion Architecture.
• Experience with cloud platforms (AWS, Azure or GCP) hosting Databricks.
• Familiarity with Git, CI/CD and version control workflows.
• Bachelor’s degree in Computer Science, Data Science, Engineering, Mathematics, Statistics or related field.

Required skills

• SQL
• Python
• Databricks Lakehouse Platform
• Delta Lake
• Delta Live Tables
• Structured Streaming
• Medallion Architecture
• Data modeling (Star Schema, Dimensional Modeling, 3NF)
• Unity Catalog
• AWS / Azure / GCP
• Git
• CI/CD