AI Quality Analyst - Personalization (Remote)

• Role: AI Quality Analyst - Personalization (Remote)
• Location: Remote (Work from Anywhere)
• Job Type: Full-Time
• Payout: Competitive, based on experience

Role Overview:

We are hiring for one of our clients, seeking an AI Quality Analyst (Personalization) - Hindi to evaluate a new personalization feature for an advanced AI model, assessing how well it uses personal data to generate relevant responses.

You will analyze the model’s ability to integrate information from past conversations, email, search, and video activity to deliver accurate and contextually appropriate outputs.

Key Responsibilities:

• Design and refine multi-turn prompts based on personal experiences to test the AI model’s personalization capabilities.

• Evaluate the quality of AI-generated responses across dimensions such as grounding, integration, and helpfulness.

• Identify instances of incorrect personalization, flawed inferences, or forced connections in model outputs.

• Compare side-by-side model responses to detect subtle differences and assess consistency.

• Provide detailed feedback on the model’s ability to align with user-specific context and intent.

Required Skills & Qualifications:

• Proficiency in Hindi with a high degree of competency in reading and writing.

• Experience in analytical evaluation of AI-generated content, particularly in personalization contexts.

• Ability to design creative and contextually relevant prompts for testing AI models.

• Strong attention to detail to assess nuanced and ambiguous AI responses.

• Willingness to use a personal Google account with enabled data sources for genuine evaluation.

• Familiarity with concepts related to AI personalization, grounding, and user intent alignment.

• Experience in multi-turn conversation analysis and response evaluation.

• Comfort with data privacy considerations when handling personal user information.

• Ability to work full-time with flexibility to support a global, 24-hour operations team.

More About the Opportunity:

This role offers the chance to contribute to the development of a cutting-edge AI system used by leading enterprises, ensuring it delivers measurable impact through reliable personalization.

Equal Opportunity Employer:

We hire based on skills and expertise. All qualified candidates are welcome regardless of background, experience, or prior employment history. Applications are reviewed solely on demonstrated technical ability and qualifications.

Apply Now!

Required Skills: AI evaluation, prompt engineering, Hindi language proficiency, quality analysis, personalization testing, AI response assessment, data analysis, multilingual evaluation, AI model testing, context understanding, attention to detail

Subtitles:

1. AI Quality Analyst (Hindi) (Remote)

2. AI Test Analyst - Personalization (Remote)

3. Multilingual AI Evaluator (Remote)