Quality Analyst (Remote)

About the role

We are seeking a remote AI Quality Analyst to evaluate a new personalization feature for an advanced language model. You will use your own experiences as context to test how well the model integrates data from past conversations, email, search history, and activity to generate relevant, helpful responses.

Key responsibilities

• Assess the quality of personalized AI responses using personal experience as a benchmark.
• Design creative, multi‑turn prompts that challenge the model’s ability to merge personal data sources accurately.
• Evaluate model outputs for grounding, integration, relevance, and identify incorrect or forced personalizations.
• Compare side‑by‑side AI responses to spot subtle differences in accuracy and usefulness.
• Provide detailed feedback to improve the model’s personalization performance.

Required profile

• Strong command of written English.
• Experience with prompt engineering or creating test cases for AI systems.
• Ability to analyse nuanced and ambiguous AI outputs with rigor.
• Familiarity with personalization concepts and evaluation metrics.
• Attention to detail for spotting subtle discrepancies.
• Willingness to use a personal Google account and enable data sources for testing.
• Full‑time availability in your local time zone to support a 24‑hour global operations team.

Required skills

• Prompt engineering
• AI model evaluation

What we offer

• Competitive compensation based on experience.
• Opportunity to work with a global leader in technology and AI.
• Fully remote work from anywhere.