Quality Analyst (Remote)

About the role

We are looking for a remote Quality Analyst to evaluate a new personalization feature for an AI model. The role involves using your own personal data sources to test how well the model integrates past conversations, email, search and activity into its responses.

Key responsibilities

• Evaluate the quality of personalized AI responses using personal experiences as context.
• Design creative multi‑turn prompts that test the model’s ability to integrate personal data accurately.
• Assess model outputs for grounding, integration, helpfulness and identify incorrect personalization.
• Review side‑by‑side AI response comparisons to detect subtle relevance and accuracy differences.
• Provide detailed feedback to improve personalization performance.

Required profile

• High proficiency in English reading and writing.
• Full‑time availability in your local time zone to support a 24‑hour global operations team.
• Willingness to use your primary personal Google account and enable personal data sources for assessment.

Required skills

• Prompt engineering.
• AI model evaluation.
• Familiarity with personalization concepts and evaluation metrics.

What we offer

• Competitive compensation based on experience.
• Opportunity to work with a global leader in technology, information and internet services.
• Fully remote work from anywhere.