Quality Analyst

Vedi l’offerta su Go Lavoro: golavoro.it/annuncio-lavoro/852nav

- Role: Quality Analyst (Remote)
- Location: Remote (Work from Anywhere)

Role Overview:
We are hiring for one of our clients, seeking an AI Quality Analyst - English to work on a full-time basis. You will evaluate a new personalization feature for an AI model by assessing how well it integrates information from past conversations, email, search, and activity to deliver relevant responses. This role requires a combination of creative prompt design and analytical evaluation of AI-generated content.
Key Responsibilities:
- Evaluate the quality of personalized responses from an AI model using your own personal experiences as context.
- Design creative, multi-turn prompts that test the model's ability to integrate personal data sources accurately.
- Assess model responses for grounding, integration, and helpfulness, identifying incorrect personalization or forced connections.




- Review side-by-side comparisons of AI responses to detect subtle differences in relevance and accuracy.
- Provide detailed feedback on model behavior to improve personalization performance.

Required Skills & Qualifications:
- English proficiency with a high degree of competence in reading and writing.
- Experience in prompt engineering or designing test cases for AI models.
- Ability to analyze nuanced and ambiguous AI responses with analytical rigor.
- Familiarity with personalization concepts and evaluation metrics in AI systems.
- Attention to detail to identify subtle discrepancies in model outputs.
- Willingness to use your primary personal Google

Vedi l’offerta su Go Lavoro: golavoro.it/annuncio-lavoro/852nav