AI-Assisted Developer Workflows
Pubblicato il 09-09-2026 - Jobgether in Italia
This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a AI-Assisted Developer Workflows (Trace) AI Task Auditor - Freelance AI Trainer Project based in Italy.
This freelance opportunity is designed for experienced technical specialists who want to help improve the quality and reliability of AI systems used in modern software development.
You will audit AI-assisted developer workflow tasks to ensure they are technically sound, realistic, reproducible, and properly evaluated.
The role involves testing complex technical scenarios, identifying workflow or logic issues, and assessing the effectiveness of supporting tests and evaluation criteria.
You’ll provide precise, actionable feedback on developer tooling, IDE integrations, AI-assisted coding workflows, and trace or telemetry analysis.
The project offers the flexibility of fully remote contract work and allows you to contribute directly to the development of more capable and dependable AI systems.
Your expertise will help ensure that AI training tasks reflect practical developer environments and meet rigorous technical standards.
Accountabilities
- Evaluate developer workflow tasks for technical accuracy, realism, solvability, reproducibility, and alignment with reliable testing and evaluation criteria.
- Audit AI-assisted development scenarios to identify technical inconsistencies, logic errors, workflow inefficiencies, or issues affecting task quality.
- Assess IDE integrations, developer tooling, telemetry and trace analysis, and AI-assisted coding workflows within assigned areas of specialization.
- Test and troubleshoot complex technical scenarios to determine whether tasks function as intended and can be consistently reproduced.
- Provide clear, detailed, and actionable feedback that enables improvements to AI training and evaluation tasks.
- Apply professional technical judgment to ensure audited workflows are practical and representat