Principal Data Engineer - II

About the role

This Principal Data Engineer position focuses on designing, developing and maintaining scalable ETL/ELT pipelines that ingest, transform and integrate data from many sources. The role also covers real-time streaming and batch processing, data storage solutions such as data lakes and data warehouses, and close collaboration with Data Scientists, Analysts, Data Architects and Data Governance teams.

Key responsibilities

• Design, develop and maintain scalable ETL/ELT pipelines
• Implement real-time streaming and batch processing solutions
• Build and optimize data lakes, data warehouses and databases
• Clean, transform and prepare raw data for analytics and machine learning
• Monitor pipeline performance and reliability, troubleshoot issues and implement data quality checks
• Work with Data Governance teams to ensure compliance with standards and policies
• Advise on data engineering best practices and recommend new technologies

Required profile

• Bachelor's or Master's degree in Computer Science, Data Engineering, Information Systems or a related field
• 7 to 8 years of experience as a Data Engineer or in a similar role
• Hands-on experience with big data tools, cloud platforms and data integration
• Strong problem-solving, analytical, communication and collaboration skills; ability to work in a fast-paced team environment

Required skills

• SQL and relational and NoSQL databases
• Data orchestration tools such as ODI, SSIS, Apache Airflow, dbt or Prefect
• Programming in Python, Java or Scala
• Familiarity with Apache Spark and Kafka

What we offer

• Competitive salary
• Fuel card
• Health benefits
• Professional development opportunities
• Inclusive work culture