Senior Data Engineer

About the role

We are looking for a Senior Data Engineer to design, build, and operate a Databricks Lakehouse platform. You will own end‑to‑end data pipelines, ensure data quality, and enable self‑service analytics for engineers, data scientists, and analysts.

Key responsibilities

• Build and own ETL/ELT pipelines ingesting data from multiple sources and design Delta Lake medallion pipelines (bronze, silver, gold) for batch and streaming.
• Provision and manage cloud data infrastructure with Terraform, including Databricks workspaces, clusters, SQL warehouses, and jobs.
• Implement Unity Catalog structures, row/column‑level security, and data masking according to governance policies.
• Assess data readiness, produce remediation plans, and maintain data validation, quality, and lineage for assigned domains.
• Optimize SQL queries, troubleshoot pipeline issues, and monitor platform performance, cost, and reliability.

Required profile

• 8+ years of data/platform engineering experience, including at least 3 years of production Databricks work.
• Strong understanding of data governance, metadata management, and data lineage concepts.
• Hands‑on experience with Snowflake, Redshift, and AWS data services.
• Experience with Terraform, CI/CD pipelines (GitHub Actions), and AI‑assisted developer tools.

Required skills

• Databricks Lakehouse, Delta Lake, Unity Catalog, Databricks SQL, and workflows/jobs.
• SQL and Python (PySpark).
• Terraform and infrastructure‑as‑code.
• Snowflake, Redshift, AWS cloud services.
• Dimensional/star schema modeling, CI/CD (GitHub Actions).