AI Safety Practitioner - Expert Evaluator

15 ago - Roma
Mercor

We are seeking experienced AI Safety Practitioners to evaluate the safety, quality, and alignment of frontier AI models across complex, policy-sensitive, and ambiguous ("grey-area") topics. You will assess AI-generated responses, apply safety policies, and help improve model behavior through structured evaluations and feedback.

Responsibilities

- Evaluate AI-generated responses for safety, factual accuracy, policy compliance, and overall quality.

- Review content involving misinformation, political persuasion, self-harm, violence, cyber, biosecurity, and other sensitive domains.

- Apply and refine evaluation rubrics for RLHF, SFT, and AI safety benchmarking.

- Identify unsafe outputs, hallucinations, reasoning failures, and policy violations.

- Provide structured feedback to improve model alignment and safety performance.

- Collaborate with AI researchers and safety teams on ongoing evaluation initiatives.

Required Qualifications

- Bachelor's degree or higher in Journalism, Communications, Psychology, Sociology, Public Policy, Law, Biology, Chemistry,



Computer Science, or a related discipline.

- 5+ years of professional experience in AI Safety, Trust & Safety, journalism, public policy, scientific research, security, or a related field.

- Excellent written English, critical thinking, and analytical reasoning skills.

- Ability to consistently evaluate nuanced and policy-sensitive scenarios.

Preferred Qualifications

- Experience with AI Safety, RLHF, SFT, Trust & Safety, or AI evaluation.

- Familiarity with safety policies, content moderation, or evaluation rubric development.

- Experience reviewing complex, high-risk, or ambiguous content.

Why Join?

- Shape the safety and behaviour of frontier AI models used by millions worldwide.

- Work on challenging, real-world safety evaluations across nuanced and high-impact domains.

- Collaborate with leading AI researchers, engineers, and safety teams.

#J-18808-Ljbffr

Addetto/a lavorazione prosciutti

15 ago - Ente di decentramento regionale di Udine
Adecco Talent Attraction

Ispettore Controllo Ambientale

15 ago - San Valentino In Abruzzo Citeriore
Consorzio Eteria

Ricevi nuove offerte di lavoro

Crea una Job Alert gratuita per ai safety practitioner - expert evaluator / roma

Renewables E&C Project Manager — Hybrid Italy

15 ago - Milano
Sonnedix

Senior Executive Consultant

15 ago - Lombardia
JX Executive