Quality Analyst (Remote)

About the role

We are seeking an AI Quality Analyst to evaluate a new personalization feature for an AI model. Working remotely, you will use your own experiences to test how well the model integrates data from past conversations, email, search, and activity to generate relevant responses.

Key responsibilities

• Assess the quality of personalized AI responses using personal context.
• Design creative multi‑turn prompts that challenge the model’s data integration capabilities.
• Evaluate model outputs for grounding, relevance, and helpfulness, flagging incorrect personalization.
• Compare side‑by‑side AI responses to detect subtle differences in accuracy.
• Provide detailed feedback to improve the model’s personalization performance.

Required profile

• Strong English reading and writing proficiency.
• Analytical rigor to examine nuanced AI outputs.
• Attention to detail for spotting subtle discrepancies.
• Willingness to use a personal Google account and enable data sources for testing.
• Full‑time availability in your local time zone to support a 24‑hour operations team.

Required skills

• Prompt engineering

What we offer

• Competitive compensation based on experience.
• Opportunity to work with a global leader in technology, information and internet services.
• Fully remote, full‑time position.