AI Quality Analyst – Remote

About the role

We are looking for an AI Quality Analyst to work remotely on a full‑time basis. You will evaluate a new personalization feature for an AI model, using your own experiences as context. The role blends creative prompt design with rigorous analysis of AI‑generated content.

Key responsibilities

• Evaluate personalized AI responses by comparing them against your personal data sources.
• Design multi‑turn prompts that test the model’s ability to integrate personal information accurately.
• Assess model outputs for grounding, integration, helpfulness, and identify incorrect personalization.
• Review side‑by‑side AI response comparisons to spot subtle relevance and accuracy differences.
• Provide detailed feedback to improve the model’s personalization performance.
• Collaborate with a global 24‑hour operations team, ensuring full‑time availability in your local time zone.

Required profile

• High proficiency in English reading and writing.
• Experience with prompt engineering or creating test cases for AI models.
• Strong analytical ability to evaluate nuanced and ambiguous AI responses.
• Familiarity with personalization concepts and AI evaluation metrics.
• Attention to detail for detecting subtle discrepancies in model outputs.

Required skills

• Prompt engineering
• AI model evaluation

What we offer

• Competitive compensation based on experience.
• Opportunity to work with a global leader in technology, information and internet services.