DevOps Engineer - AI Model Evaluator
Pubblicato il 29-10-2026 - Mercor in Italiah3About the job /h3pMercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . /ph3Position /h3pDevOps / SRE / Cloud Engineer (Coding Agent Experience) /ph3Type /h3pContract /ph3Compensation /h3p$85/hour /ph3Location /h3pRemote /ph3Role Responsibilities /h3ulliUse frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks. /liliReview model-generated implementations involving cloud platforms , Kubernetes , CI/CD systems , observability , and infrastructure automation . /liliIdentify bugs, edge cases, reliability issues, and failure modes in model outputs. /liliCompare outputs from multiple frontier models to assess their strengths and weaknesses. /liliApply professional engineering judgment to realistic infrastructure engineering scenarios. /li /ulh3Qualifications Must-Have /h3ulli2+ years of professional DevOps , SRE , or Cloud Engineering experience. /liliExperience with AWS , Azure , GCP , Kubernetes , Terraform , CI/CD pipelines , or observability tooling. /liliRegular use of AI coding agents such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools. /liliAbility to evaluate model-generated infrastructure and reliability engineering solutions. /li /ulh3Preferred /h3ulliExperience supporting production-scale systems. /li /ulh3Compensation Legal /h3p$400 per accepted task /ppCompensation tied to accepted work. /ph3Application Process (Takes 20–30 mins to complete) /h3ulliUpload resume /liliAI interview based on your resume /liliSubmit form /li /ulh3Resources Support /h3ulliFor details about the interview process and platform information, please check: /liliFor any help or support, reach out to: /li /ulpPS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity. /p #J-18808-Ljbffr