AI Quality Analyst – Personalization (Remote)

About the role

We are looking for a remote AI Quality Analyst specialized in personalization to evaluate a new feature of an advanced AI model. You will assess how effectively the model uses personal data from past interactions, email, search, and video activity to generate relevant, context‑aware responses.

Key responsibilities

• Design and refine multi‑turn prompts based on personal experiences to test personalization capabilities.
• Evaluate AI‑generated responses for grounding, integration, helpfulness, and relevance.
• Identify incorrect personalization, flawed inferences, or forced connections in model outputs.
• Compare side‑by‑side model responses to detect subtle differences and assess consistency.
• Provide detailed feedback on alignment with user‑specific context and intent.

Required profile

• Fluent in Hindi with strong reading and writing skills.
• Experience evaluating AI‑generated content, especially in personalization contexts.
• Ability to craft creative, context‑rich prompts for AI testing.
• Strong attention to detail for nuanced response assessment.
• Willingness to use a personal Google account with enabled data sources for authentic evaluation.

Required skills

• AI evaluation
• Prompt engineering
• Hindi language proficiency
• Data analysis

What we offer

• Competitive compensation based on experience.
• Full‑time remote work with flexible hours.
• Opportunity to influence personalization in cutting‑edge AI systems used by leading enterprises.