AI Quality Analyst – Remote

About the role

We are looking for a remote AI Quality Analyst to evaluate a new personalization feature for an AI model. The role involves using your own experiences as context to test how well the model integrates data from past conversations, email, search and activity to generate relevant responses.

Key responsibilities

• Assess the quality and relevance of personalized AI responses using personal data sources.
• Design multi‑turn prompts that challenge the model’s ability to integrate personal information accurately.
• Identify grounding errors, forced connections, and inaccuracies in model outputs.
• Compare side‑by‑side AI responses to spot subtle differences in relevance and correctness.
• Provide detailed feedback to improve the model’s personalization performance.

Required profile

• Fluent English with strong reading and writing skills.
• Full‑time availability in your local time zone to support a 24‑hour global operations team.
• Willingness to use your primary Google account and enable personal data sources for testing.

Required skills

• Prompt engineering or experience designing test cases for AI models.
• Analytical ability to evaluate nuanced and ambiguous AI responses.
• Attention to detail for detecting subtle discrepancies in model outputs.

What we offer

• Competitive compensation based on experience.
• Opportunity to work with a global leader in technology, information and internet services.
• Fully remote work from anywhere.