Senior Data Engineer

About the role

ShipIn Systems is seeking a Senior Data Engineer to own and evolve the data pipelines that power its AI‑driven fleet intelligence platform. You will work on‑premise aboard vessels, handling high‑volume video streams in real‑time, and integrate these pipelines with AWS cloud services.

Key responsibilities

• Design, implement and optimise on‑prem data pipelines for performance, reliability and real‑time throughput.
• Own the full pipeline lifecycle, from stabilising existing systems to redesigning architecture for scaling.
• Develop high‑performance stream and batch pipelines for large‑scale video and telemetry data.
• Integrate on‑prem pipeline infrastructure with AWS cloud services, including deployment workflows and data publishing.
• Collaborate with ML, computer‑vision, DevOps and product teams to deploy models in resource‑constrained edge environments.
• Troubleshoot and resolve pipeline issues quickly to minimise downtime on vessels.

Required profile

• 5+ years of experience designing and operating production data pipelines.
• Strong Python proficiency as the primary development language.
• Hands‑on experience with PostgreSQL or equivalent relational databases.
• Solid understanding of integrating ML models into large‑scale production environments.
• Experience working across hybrid on‑prem and cloud architectures, preferably AWS.

Required skills

• Python
• PostgreSQL
• AWS
• Rust or C++ (advantage)
• Video/image processing pipelines (advantage)