09 set - Italia
Jobgether
This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a SWE-Bench AI Task Auditor - Freelance AI Trainer Project based in Italy.
This freelance opportunity is designed for experienced software engineering professionals who want to contribute their expertise to the development and evaluation of advanced AI systems.
You will audit software engineering tasks used to train and assess AI models, ensuring they reflect realistic and technically rigorous development scenarios.
The role focuses on evaluating complex codebases, validating task logic, and determining whether tests and evaluation criteria are reliable and reproducible.
You will identify integration problems, test failures, and technical inconsistencies and provide actionable feedback to improve task quality.
Your expertise will directly contribute to making AI training workflows more accurate, practical, and aligned with real-world software engineering standards.
The project offers a flexible freelance environment where your specialized technical knowledge can have a meaningful impact on AI development.
This is an opportunity to apply deep software engineering experience to challenging technical evaluation work while working independently on project-based assignments.
Accountabilities
- Evaluate software engineering tasks for technical accuracy, realism, solvability, reproducibility, and alignment with established SWE-Bench standards.
- Review complex codebases and real-world application scenarios to determine whether tasks accurately reflect practical software engineering challenges.
- Assess the reliability and completeness of tests, evaluation criteria, and expected outcomes associated with assigned tasks.
- Identify codebase integration issues, logic errors, test failures, and other technical inconsistencies that could affect task quality or evaluation accuracy.
- Troubleshoot complex technical scenarios and provide clear, actionabl
11 set - Sassari
SYNERGIE ITALIA - AGENZIA PER IL LAVORO
11 set - Roma
Wally Job
11 set - Roma
cm servizi alberghieri srls
11 set - Perugia
Angeli Assistenza