AI Quality Analyst – Remote

About the role

We are looking for an AI Quality Analyst to work remotely on a full‑time basis. In this role you will evaluate a new personalization feature for an AI model, using your own experiences as context to assess how well the system integrates data from past conversations, email, search and activity.

Key responsibilities

• Evaluate the quality of personalized AI responses using personal experiences as context.
• Design creative, multi‑turn prompts that test the model’s ability to integrate personal data sources accurately.
• Assess model outputs for grounding, integration, helpfulness, and identify incorrect personalization.
• Review side‑by‑side AI response comparisons to detect subtle relevance and accuracy differences.
• Provide detailed feedback to improve the model’s personalization performance.

Required profile

• High proficiency in English reading and writing.
• Experience in prompt engineering or designing test cases for AI models.
• Strong analytical ability to evaluate nuanced and ambiguous AI responses.
• Familiarity with personalization concepts and AI evaluation metrics.
• Willingness to use a personal Google account and enable personal data sources for assessment.
• Full‑time availability in your local time zone to support a 24‑hour global operations team.

Required skills

• Prompt engineering

What we offer

• Competitive payout based on experience.
• Opportunity to work with a global leader in technology, information and internet services.
• Fully remote work arrangement.