Quality Analyst – AI Personalization (Remote)

About the role

We are looking for an AI Quality Analyst to evaluate a new personalization feature for an AI model. Working remotely, you will use your own experiences and personal data sources to test how well the model integrates past conversations, email, search and activity into its responses.

Key responsibilities

• Evaluate the quality of personalized AI responses using personal experiences as context.
• Design creative multi‑turn prompts that test the model’s ability to integrate personal data accurately.
• Assess model outputs for grounding, integration, helpfulness and identify incorrect personalization.
• Review side‑by‑side AI response comparisons to spot subtle relevance and accuracy differences.
• Provide detailed feedback to improve personalization performance.

Required profile

• High proficiency in English reading and writing.
• Experience in prompt engineering or designing test cases for AI models.
• Ability to analytically evaluate nuanced and ambiguous AI responses.
• Familiarity with personalization concepts and AI evaluation metrics.
• Willingness to use a personal Google account and enable personal data sources for assessment.

Required skills

• Prompt engineering

What we offer

• Competitive payout based on experience.
• Opportunity to work with a global leader in technology, information and internet.
• Fully remote, flexible work arrangement.