SQAE - Automation (AI & LLM Testing)

About the role

The SQAE is a hands-on quality assurance role covering end-to-end functional, automation, API and non-functional testing of AI-powered applications, LLM-based solutions, RAG systems and integrated enterprise platforms. It combines functional testing expertise with automation framework development, API test automation, programming, CI/CD integration and automated load and performance testing. The role focuses on establishing test coverage, validating AI-generated responses, identifying quality risks and ensuring application reliability, scalability and performance.

Key responsibilities

• Design, develop, execute and maintain automated test scripts for web apps, APIs and workflows using Selenium, Playwright or Cypress
• Build and maintain reusable automation frameworks in Java, Python, JavaScript or TypeScript
• Run functional, regression, integration, exploratory and end-to-end testing, and validate LLM apps, AI chatbots and RAG systems
• Test AI response consistency, factual correctness, negative inputs and multi-turn conversations, and set pass/fail criteria
• Automate API tests (REST) and integrate test suites into CI/CD pipelines
• Perform automated load, stress, scalability and performance testing with JMeter or k6
• Validate backend data, security scenarios (prompt injection, unauthorized access) and defect tracking
• Coordinate with Product, Engineering and client stakeholders on release readiness

Required profile

• 1-2 years of QA experience with substantial hands-on automation testing
• Proven experience with automated UI and API tests, automation frameworks and CI/CD integration
• Hands-on programming in Java, Python, JavaScript or TypeScript for test automation
• Experience with automated load and performance testing, backend validation and defect investigation
• Working understanding of AI, LLMs and RAG; testing AI chatbots or RAG pipelines preferred
• Agile, Scrum, Hybrid or project-based delivery experience preferred; immediate joiner preferred

Required skills

• Selenium, Playwright, Cypress or equivalent automation frameworks
• Java, Python, JavaScript or TypeScript (Python preferred)
• API testing with Postman, REST APIs, Pytest or equivalent
• Jenkins, Azure DevOps, GitHub Actions, GitLab CI or similar
• JMeter, k6 or equivalent; SQL, Jira, Azure DevOps, TestRail, Kualitee
• ISTQB CTFL mandatory; automation or performance testing certifications an advantage