05 ott - Italia
SME Careers
In this hourly, remote contractor role, you will work as an Attorney / Lawyer Subject Matter Expert (SME) to review AI-generated legal responses and/or create expert legal content, evaluating reasoning quality and step-by-step issue analysis while providing precise written feedback. You will assess solutions for accuracy, clarity, completeness, and adherence to the prompt; identify errors in legal reasoning, rule application, procedural steps, and risk/assumption handling; fact-check legal concepts and (when required) citations; write high-quality explanations and model answers that demonstrate correct legal analysis and clear communication; and rate and compare multiple responses based on correctness and reasoning quality. This role is with SME Careers, a fast-growing AI Data Services company and subsidiary of SuperAnnotate, delivering training data for many of the world’s largest AI companies and foundation-model labs. Your legal expertise directly helps improve the world’s premier AI models by making their legal reasoning more accurate, reliable, and clearly explained.
Important
There is no immediate project for this role; however, if qualified, you will be among the first experts we reach out to when relevant opportunities arise. This will also provide you with access to future projects available through our expert network.
Key Responsibilities
• Develop AI Training Content: Create detailed prompts and gold-standard legal outputs (issue analyses, drafting examples, checklists, policies, and memos).
• Optimize AI Performance: Evaluate and rank AI responses to improve correctness, clarity, defensibility, and risk awareness.
• Ensure Model Integrity: Test AI outputs for inaccuracies, misleading certainty, confidentiality risks, and bias; validate reliability across legal scenarios.
Your Profile
• JD/LLB (or equivalent law degree) and active bar membership (or eligibility) in at least one jurisdiction.
• 5+ years of professional experience practicing law (law
08 ott - Piemonte
CGM Consulting
08 ott - Palazzolo sull'Oglio
Axl Agenzia Per Il Lavoro
08 ott - Roma
Lavoroestage
08 ott - Padova
Randstad Filiale di Camposampiero