Quality Analyst – AI Personalization (Remote)

About the role

We are seeking a full‑time Quality Analyst to evaluate a new personalization feature for an AI model. The role involves using your own experiences as context to test how well the model integrates data from past conversations, email, search, and activity to generate relevant responses.

Key responsibilities

• Assess the quality of personalized AI responses using personal experience as context.
• Design multi‑turn prompts that challenge the model’s ability to integrate personal data accurately.
• Identify grounding issues, incorrect personalization, or forced connections in model outputs.
• Compare side‑by‑side AI responses to spot subtle relevance and accuracy differences.
• Provide detailed feedback to improve the model’s personalization performance.

Required profile

• Strong English reading and writing proficiency.
• Experience with prompt engineering or creating test cases for AI models.
• Analytical rigor for evaluating nuanced and ambiguous AI outputs.
• Familiarity with personalization concepts and AI evaluation metrics.
• Attention to detail to detect subtle discrepancies.
• Willingness to use a personal Google account and enable personal data sources for testing.
• Full‑time availability in your local time zone to support a 24‑hour global team.

Required skills

• Prompt engineering

What we offer

• Competitive compensation based on experience.
• Opportunity to work with a global leader in technology, information, and internet services.
• Remote work from anywhere.