Senior Data Annotation Jobs In Rome

Vedi l’offerta su Go Lavoro: golavoro.it/annuncio-lavoro/8okayi

About The RoleSenior data annotation is a Mid-Senior, full-time remote role focused on training data quality for AI/ML systems—labeling, RLHF, prompt evaluation, and QA evaluation that directly improve model performance.
Consulti la panoramica del ruolo qui sotto.
Se è affidabile/a di possedere le giuste competenze ed esperienze, si candidi oggi stesso.
You will help build reliable LLM training pipelines by applying annotation guidelines compliance, auditing datasets, and refining instructions for human feedback.
What You Will DoOwn and execute complex annotation tasks across NLP and computer vision annotation (e.g., named entity recognition, classification, ranking, span labeling)
Perform RLHF workflows (preference comparisons, rationale checks, policy-aligned scoring) and prompt evaluation for LLM training pipelines
Run QA evaluation using sampling plans, inter-annotator agreement checks, and targeted error analysis




Maintain annotation guidelines compliance by documenting decisions, escalating ambiguous cases, and updating rubrics
Partner with stakeholders across AI labs, tech startups, BPO teams, and annotation vendors to deliver production-ready datasets on schedule
Required QualificationsProduction experience in data annotation/data labeling or QA evaluation for AI/ML xysqume systems
Strong understanding of training data quality and guideline-driven labeling
Familiarity with RLHF and large language model evaluation concepts (prompt evaluation, preference ranking)
High attention to detail, consistent decision-making, and comfort with ambiguous edge cases
Clear written communication and precise documentation habits
#J-*****-Ljbffr

Vedi l’offerta su Go Lavoro: golavoro.it/annuncio-lavoro/8okayi