AI Quality Analyst – Remote

About the role

We are seeking an AI Quality Analyst to evaluate a new personalization feature for an AI model. Working remotely, you will use your own personal data sources to test how well the model integrates past conversations, email, search history, and activity into relevant responses.

Key responsibilities

• Assess the quality of personalized AI responses using personal experiences as context.
• Design creative multi‑turn prompts that challenge the model’s ability to merge personal data accurately.
• Evaluate model outputs for grounding, integration, helpfulness, and identify incorrect personalization.
• Compare side‑by‑side AI responses to spot subtle relevance and accuracy differences.
• Provide detailed feedback to improve the model’s personalization performance.

Required profile

• Strong English reading and writing proficiency.
• Experience with prompt engineering or creating test cases for AI models.
• Analytical mindset capable of dissecting nuanced and ambiguous AI outputs.
• Attention to detail for spotting subtle discrepancies.
• Willingness to use a personal Google account and enable personal data sources for testing.
• Full‑time availability in your local time zone to support a 24‑hour global operations team.

Required skills

• Prompt engineering

What we offer

• Competitive compensation based on experience.
• Opportunity to work with a global leader in technology and AI.
• Fully remote work from anywhere.