Senior Anti-Bot Engineer – Remote

About the role

Smart Working is looking for a Senior Anti-Bot Engineer to design, build, and operate large‑scale web scraping systems that can reliably extract high‑quality data from heavily protected, constantly changing websites. This remote, full‑time position focuses on creating production‑grade pipelines that survive adversarial anti‑bot measures and dynamic page structures.

Key responsibilities

• Design and maintain Python‑based scraping infrastructure targeting highly protected sites, including Google‑like environments.
• Implement resilient extraction solutions for JavaScript‑heavy pages using browser automation and hybrid techniques.
• Continuously adapt systems to frequent changes in page layouts, request flows, and anti‑bot mechanisms.
• Build robust data pipelines with strong observability, fault tolerance, and accuracy.
• Apply advanced strategies such as proxy rotation, fingerprinting, session management, and request routing to ensure stability at scale.
• Monitor system health, detect anomalies, and debug complex production failures across distributed cloud environments.
• Optimize performance, cost efficiency, and reliability of the scraping infrastructure.
• Collaborate with data engineering and product teams to validate and structure scraped data.
• Document architecture, scraping logic, and operational procedures for long‑term maintainability.

Required profile

• Several years of experience building and operating large‑scale distributed systems in production.
• Strong systems thinking and ability to work independently in ambiguous, adversarial environments.
• Proven track record of owning end‑to‑end data pipelines.

Required skills

• Python programming.
• JavaScript knowledge for handling dynamic web content.

What we offer

• Fully remote work environment with a supportive global community.
• Long‑term, full‑time engagement on challenging technical problems.
• Opportunities for professional growth and continuous learning.