Senior QA Engineer - Automation

About the role

Convo is seeking a Senior QA Engineer specialized in automation to design and maintain robust testing frameworks for APIs, agent workflows, tool calls, and critical UI experiences. The ideal candidate brings 5+ years of test‑automation experience, strong Python and pytest expertise, and a deep understanding of asynchronous and distributed systems.

Key responsibilities

• Create API and workflow regression suites for orchestrator, planner, and tool‑registry components.
• Build deterministic assertions around schemas, tool‑call sequences, constraints, and expected side effects.
• Develop pytest‑based service tests and Playwright tests for console UI workflows.
• Design reusable mocks, simulators, and fixtures for tools, model responses, and external dependencies.
• Integrate test suites into CI pipelines, publish actionable results, and address flaky‑test issues.
• Maintain traceability from technical requirements and defects to automated test coverage.

Required profile

• Minimum 4 + years in test automation, including 2 + years testing APIs, asynchronous workflows, or distributed services.
• Strong Python programming skills and extensive experience with pytest.
• Proficiency with Playwright or comparable browser‑automation tools for UI testing.
• Hands‑on experience integrating tests into CI/CD pipelines and reporting results.
• Ability to validate contracts/schemas for REST and event‑driven interfaces.
• Experience designing reusable fixtures, mocks, and service simulators.

Required skills

• Python
• pytest
• API testing
• Playwright (or similar browser automation)
• CI/CD integration
• Contract/schema validation
• Asynchronous workflow testing
• Mocks, fixtures, simulators

What we offer

• Competitive compensation package with medical benefits for you and your family.
• Free lunch, annual performance‑tied salary increments, and recognition awards.
• Lean, agile work culture that values diversity and inclusion.