AI Quality Analyst – Remote

About the role

We are seeking an AI Quality Analyst to work remotely on a full‑time basis. In this position you will evaluate a new personalization feature for an AI model, using your own experiences as context to assess how well the system integrates data from past conversations, email, search and activity.

Key responsibilities

• Assess the quality of personalized AI responses, checking for accurate grounding and relevance.
• Design creative multi‑turn prompts that challenge the model’s ability to merge personal data sources.
• Identify incorrect personalization, forced connections, or subtle relevance issues in model outputs.
• Conduct side‑by‑side comparisons of AI responses to spot differences in accuracy and usefulness.
• Provide detailed feedback to improve the model’s personalization performance.

Required profile

• Strong English reading and writing proficiency.
• Experience with prompt engineering or creating test cases for AI models.
• Analytical mindset capable of evaluating nuanced and ambiguous AI outputs.
• Willingness to use your primary personal Google account and enable personal data sources for testing.
• Full‑time availability in your local time zone to support a 24‑hour global operations team.

Required skills

• Prompt engineering
• AI model evaluation
• Personalization evaluation

What we offer

• Competitive compensation based on experience.
• Opportunity to work with a global leader in technology, information and internet services.
• Fully remote work from anywhere.