AI Safety Practitioner - Expert Evaluator

13 ago - Milano
Mercor

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: AI Safety Practitioner

Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities

- Evaluate AI-generated responses for safety, factual accuracy, policy compliance, and overall quality.
- Review content involving misinformation, political persuasion, self-harm, violence, cyber, biosecurity, and other sensitive domains.
- Apply and refine evaluation rubrics for RLHF, SFT, and AI safety benchmarking.
- Identify unsafe outputs, hallucinations, reasoning failures, and policy violations.
- Provide structured feedback to improve model alignment and safety performance.
- Collaborate with AI researchers and safety teams on ongoing evaluation initiatives.

Qualifications Must-Have

- Bachelor's degree or higher in Journalism, Communications, Psychology, Sociology, Public Policy, Law, Biology, Chemistry, Computer Science, or a related discipline.




- 5+ years of professional experience in AI Safety, Trust & Safety, journalism, public policy, scientific research, security, or a related field.
- Excellent written English, critical thinking, and analytical reasoning skills.
- Ability to consistently evaluate nuanced and policy-sensitive scenarios.

Preferred

- Experience with AI Safety, RLHF, SFT, Trust & Safety, or AI evaluation.
- Familiarity with safety policies, content moderation, or evaluation rubric development.
- Experience reviewing complex, high-risk, or ambiguous content.

Application Process (Takes 20–30 mins to complete)

- Upload resume
- AI interview based on your resume
- Submit form

Resources & Support

- For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
- For any help or support, reach out to: (email hidden)

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity. ,

Addetti al fast food-part time-Codroipo (UD)

14 ago - Codroipo
Umana

Aiuto pizzaiolo

14 ago - Rovigo
Privato

Ricevi nuove offerte di lavoro

Crea una Job Alert gratuita per ai safety practitioner - expert evaluator / milano

Consegne a domicilio Cittadella

14 ago - Cittadella
Food Racers

(PI) Addetti/e alle pulizie

14 ago - Lucca
La Risorsa Umana