Big Data Engineer (Remote)

About the role

We are seeking a Big Data Engineer to design, build, and maintain scalable data pipelines that support both real‑time and batch processing. The position is fully remote and works full‑time, collaborating with cross‑functional teams to ensure data integrity and accessibility across the organization.

Key responsibilities

• Design and implement ETL/ELT pipelines to ingest, transform, and load data from multiple sources into data warehouses and lakes.
• Develop and optimise data models to support analytics and reporting needs.
• Collaborate with data scientists and analysts to ensure data quality and availability for downstream applications.
• Monitor pipeline performance and troubleshoot issues to maintain system reliability.
• Implement and enforce data governance, security, and compliance standards.

Required profile

• Proficiency in Python, SQL, and data‑pipeline tools such as Apache Airflow.
• Experience with cloud platforms (AWS, GCP, or Azure) and related data services (e.g., BigQuery, Redshift, S3).
• Strong understanding of data‑warehousing concepts and dimensional modelling.
• Familiarity with big‑data technologies (Spark, Hadoop) and streaming platforms (Kafka).
• Knowledge of data‑governance, metadata management, and data‑quality frameworks.

Required skills

• Python
• SQL
• Apache Airflow
• AWS
• GCP
• Azure
• BigQuery
• Redshift
• S3
• Spark
• Hadoop
• Kafka