Quality Analyst – AI Personalization (Remote)

About the role

We are seeking a remote Quality Analyst to evaluate a new personalization feature for an AI model. You will use your own experiences as context to test how well the model integrates data from past conversations, email, search, and activity to generate relevant responses.

Key responsibilities

• Evaluate the quality of personalized AI responses using personal experience as context.
• Design creative multi‑turn prompts that challenge the model’s ability to integrate personal data accurately.
• Assess model outputs for grounding, integration, helpfulness, and identify incorrect personalization.
• Review side‑by‑side comparisons of AI responses to spot subtle relevance and accuracy differences.
• Provide detailed feedback to improve the model’s personalization performance.

Required profile

• Strong English reading and writing proficiency.
• Experience in prompt engineering or creating test cases for AI models.
• Ability to analyze nuanced and ambiguous AI responses with rigor.
• Familiarity with personalization concepts and evaluation metrics in AI systems.
• Attention to detail for detecting subtle output discrepancies.
• Willingness to use a personal Google account and enable personal data sources for assessment.
• Full‑time availability in your local time zone to support a 24‑hour global operations team.

Required skills

• Prompt engineering
• AI model evaluation

What we offer

• Competitive compensation based on experience.
• Fully remote work from anywhere.
• Opportunity to contribute to advanced AI systems at a global technology leader.