Data Engineer

About the role

Medcare MSO is seeking a Data Engineer to design and develop scalable data extraction, web‑scraping and automation solutions that feed our AI‑driven healthcare platforms. You will collaborate closely with AI, Machine Learning and Product teams to acquire, transform and deliver data from a variety of web, API and desktop sources.

Key responsibilities

• Build and optimise end‑to‑end data pipelines for ingesting structured and unstructured data.
• Develop robust web‑scraping solutions using Python frameworks such as Scrapy, Beautiful Soup, Selenium and Playwright.
• Create browser‑automation workflows that handle anti‑bot measures, proxy rotation, CAPTCHA and session management.
• Automate desktop‑application data extraction using UiPath, Automation Anywhere or Power Automate Desktop.
• Write efficient Python scripts and SQL queries for large‑scale data processing, validation and transformation.
• Integrate OCR technologies (Tesseract, ABBYY) to extract data from scanned or legacy documents.
• Connect REST APIs and external sources to automated ingestion pipelines.
• Collaborate with ML engineers to provide clean, feature‑ready datasets for model training.
• Maintain data storage solutions, including relational databases, data warehouses and data lakes.
• Implement data quality checks, monitoring, logging and lineage tracking.

Required profile

• Bachelor’s degree in Computer Science, Data Engineering, Software Engineering or a related field.
• 2–4 years of hands‑on experience in data engineering, web scraping or automation.
• Strong problem‑solving skills and ability to work in a fast‑paced, cross‑functional environment.

Required skills

• Python programming
• Scrapy, Beautiful Soup, Selenium, Playwright
• UiPath, Automation Anywhere, Power Automate Desktop
• SQL and relational database design
• OCR tools – Tesseract, ABBYY
• REST API integration
• Data pipeline orchestration (ETL/ELT)
• Experience with data warehouses and data lake architectures