Domain Advisor Consultant
Pubblicato il 06-09-2026 - Jobgether in Italia
This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Domain Advisor Consultant (Subject Matter Expert) based in Italy.
This is an opportunity for an established subject matter expert to help define the standards by which next-generation AI systems are evaluated and improved.
You will bring deep professional or academic expertise to complex AI evaluation and training projects.
The role focuses on creating rigorous benchmarks, assessing model reasoning, and identifying gaps in AI-generated outputs.
You will help translate expert knowledge into clear evaluation criteria, reference examples, and actionable guidance.
Engagements are project-based, flexible, and designed for independent professionals who value autonomy.
Your work can directly influence the accuracy, reasoning quality, and safety of AI systems used at significant scale.
This is a highly analytical consulting opportunity for experts who want to shape how AI performs within their field.
n
Accountabilities
Review and advise on evaluation criteria and scoring rubrics to determine whether AI-generated outputs meet professional standards within your area of expertise.
Create, edit, and validate high-quality benchmark tasks, prompts, and responses that can serve as trusted reference data for AI training and evaluation.
Analyze model failures, including hallucinations, flawed reasoning, and logical inconsistencies, and provide expert explanations of their causes and potential improvements.
Assess the complexity, nuance, and difficulty of evaluation scenarios to ensure AI systems are tested against sufficiently rigorous and realistic professional challenges.
Clearly document expert reasoning and recommendations so that technical teams can translate domain knowledge into practical AI evaluation and training methodologies.
Work under project-specific Statements of Work, delivering agreed outcomes within defined timelines while maintaining