Italian-Speaking JSON

25 ott - Roma
Lifted, an Upwork

Job Description

- Participating in live, real-time conversational scenarios with AI systems
- Reviewing and labeling conversation transcripts
- Evaluating AI-generated responses using structured rubrics and providing written justifications
- Assessing responses for language quality, customer experience, technical accuracy, formatting, and JSON structure
- Capturing required session artifacts, including recordings, Session IDs, and tool-call/console logs - Environment preparation and tool verification before each session.

Experts should speak naturally and spontaneously, as if responding in real time, without pre-planned, written, or scripted responses - the client is evaluating natural voice cadence.

Qualifications

To be considered for this project, experts are required to pass a basic computational concepts assessment (JSON structures, function, general reasoning, and language proficiency), which takes about 15 minutes to complete, and will not be compensated. If the expert passes the assessment,



they will be provided with further onboarding steps.
“Operator” requirements:
- Strong spoken-language proficiency: C1/C2-level fluency (CEFR) in the target evaluation language, verified through a speaking/listening assessment, not just a resume claim.
- Technical literacy: JSON fluency required - reading, validating, troubleshooting, and identifying structural/formatting issues
- Audio setup: capable of producing clear audio quality with no background noise

Additional Information

Ideal experts will have strong attention to detail, strong written communication skills, and the ability to evaluate both the customer experience and the technical correctness of a response. A solid understanding of JSON is especially important, including the ability to read, validate, troubleshoot, and identify structural or formatting issues.

Veterinary Leader for Doctors in Italy Fellowship Program

26 ott - Perugia
Federation of Veterinarians of Europe

Senior Business Developer (m/w/d) Photovoltaik oder Battery Storage / Joobz

26 ott - Caldaro
Kreatif Multimedia

Ricevi nuove offerte di lavoro

Crea una Job Alert gratuita per italian-speaking json / roma

Pediatra Ospedaliero — Turni 3, Contratto Indeterminato

26 ott - Como
Michael Page International Italia

Approvisionneur SAP

26 ott - Messina
Webuild