Data Engineer - Azure Synapse & PySpark

About the role

Systems Ltd is looking for a data engineer with a deep background in data engineering and expertise in designing and implementing cloud-based data warehousing solutions using Azure Synapse. The ideal candidate is a strategic thinker who has delivered scalable and efficient data solutions to meet complex business requirements.

Key responsibilities

• Design and implement highly scalable, high-performance data warehousing solutions in Azure Synapse.
• Analyze and migrate existing data systems to the Azure cloud, optimizing data flow and collection to improve data accuracy and utility.
• Contribute to data architecture design and modeling, aligned with business needs and data governance standards.
• Consult with stakeholders to define data requirements, deliverables and timelines, providing technical leadership throughout project lifecycles.
• Implement data security and privacy policies in line with industry best practices and organizational standards.
• Optimize data integration pipelines for performance and scalability.
• Develop and maintain documentation of data architectures, procedures and solutions.

Required profile

• Bachelor's or master's degree in computer science, engineering, information technology or a related field.
• 4+ years of experience in data engineering with a strong focus on cloud-based solutions.
• Proven consulting or advisory roles in designing and deploying large-scale data solutions in Azure environments.
• Experience working directly with clients or stakeholders, translating business needs into technical specifications.
• Ability to contribute to project leadership, coordinate across client functional groups and manage client relationships.

Required skills

• Azure Synapse Analytics, including data integration, management and security.
• SQL, Python and PySpark.
• Azure IaC (ARM, Bicep or Terraform) and CI/CD automation.
• ELT and ETL processes and Azure Data Factory.
• Data modeling (Data Vault 2.0 experience or certification preferred).
• Preferred: Microsoft Certified: Azure Data Engineer Associate, Azure Solutions Architect Expert, and Certified Data Vault 2.0 Practitioner.