Remote Data Annotation Specialist (Milan)
Pubblicato il 26-10-2026 - RemoExperts in Romano di Lombardia
Remote Data Annotation Specialist (Milan) — Remote (US-listed)Rex.zone connects Milan-based talent with full-time remote AI data work supporting LLM training pipelines, RLHF, and model evaluation.
You will label, review, and QA training data using clear rubrics and annotation guidelines to improve model quality and safety.
What You Will Do
- Produce labeled examples for NLP and computer vision annotation tasks
- Perform prompt evaluation, rubric scoring, and RLHF preference ranking/response ranking
- Execute QA evaluation using gold sets, peer review, audits, and disagreement resolution
- Apply named entity recognition (span labeling) and taxonomy-based labeling
- Support content safety labeling (policy-driven categories) and escalata ambiguous cases
- Document annotation decisions and ensure annotation guidelines compliance
Core Workflows
- RLHF ranking and instruction-following grading
- Inter-annotator agreement checks and training data quality audits
- Adversarial/edge-case prompt evaluation
- Computer vision annotation (bounding boxes,
polygons, keypoints)
Requirements
- 3+ years in data annotation, data labeling, QA evaluation, or ML data operations
- Strong written English and ability to follow detailed rubrics
- Familiarity with LLM evaluation concepts (preference ranking, instruction tuning)
- Comfort with annotation tools and structured labeling schemas
- Ability to maintain high accuracy under throughput targets
- Security-minded approach to handling potentially sensitive content
Employment NotesThis is a FULL_TIME Remote role aligned to Milan-based availability; projects may span multiple time zones depending on client needs. xysqume
Pay: Competitive hourly rate: $30–$50 per hour (USD)
Può ottenere maggiori dettagli sulla natura di questa posizione e sui requisiti per i candidati leggendo quanto segue.
Per questa posizione sono disponibili opzioni di lavoro a distanza/a casa.