Data Engineer

About the role

Mobilink Bank is seeking a Data Engineer to design, build and maintain its Medallion Architecture on a MinIO‑based Delta Lake. The role will create scalable batch and streaming pipelines, ensure data quality and governance, and support analytics, BI and machine‑learning use cases.

Key responsibilities

• Design, build and maintain Raw, Curated and Semantic zones of the data lake, defining standards for structure, partitioning and retention.
• Develop end‑to‑end pipelines for ingestion (Kafka, Sqoop, Trino), transformation (Spark) and enrichment (Delta Lake on MinIO), covering both batch and Structured Streaming workloads.
• Implement OLAP columnar models (Parquet) and maintain the Semantic zone for trusted datasets used by BI, analytics and data‑science teams.
• Collaborate with governance teams to ensure data discoverability, quality, lineage (OpenMetadata) and compliance with security standards.
• Drive performance tuning of Spark jobs, SQL queries and Trino federated queries, and evaluate emerging big‑data technologies.

Required profile

• Bachelor's or Master's degree in Computer Science, IT or related field.
• 3–5 years of professional experience in data engineering, ETL development or similar roles.
• Strong SQL development and database optimisation experience with Oracle 19c, PostgreSQL and MySQL.
• Hands‑on experience building batch and streaming pipelines using Apache Spark (PySpark) and Trino.
• Practical knowledge of object storage (MinIO, S3) and Delta Lake architecture.

Required skills

• Medallion Data Architecture (Raw → Curated → Semantic)
• Apache Spark (PySpark), batch and Structured Streaming
• Trino / Presto data federation
• Delta Lake, MinIO, S3 object storage
• SQL, Oracle 19c, PostgreSQL, MySQL
• Kafka, Sqoop for data ingestion
• Python and R for ETL automation
• Tableau for data visualisation
• Data modelling with Parquet columnar format
• OpenMetadata for data lineage and governance