Talent.com
Mercor
DevOps Engineer - AI Model EvaluatorMercor • Milan, Lombardy, Italy
DevOps Engineer - AI Model Evaluator

DevOps Engineer - AI Model Evaluator

Mercor • Milan, Lombardy, Italy
1 giorno fa
Tipo di contratto
  • Remoto
  • Quick Apply
Descrizione dell’offerta di lavoro

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience)
Type: Contract
Compensation: $85/hour
Location: Remote

Role Responsibilities

  • Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks.
  • Review model-generated implementations involving cloud platforms, Kubernetes, CI/CD systems, observability, and infrastructure automation.
  • Identify bugs, edge cases, reliability issues, and failure modes in model outputs.
  • Compare outputs from multiple frontier models to assess their strengths and weaknesses.
  • Apply professional engineering judgment to realistic infrastructure engineering scenarios.

Qualifications

Must-Have

  • 2+ years of professional DevOps, SRE, or Cloud Engineering experience.
  • Experience with AWS, Azure, GCP, Kubernetes, Terraform, CI/CD pipelines, or observability tooling.
  • Regular use of AI coding agents such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools.
  • Ability to evaluate model-generated infrastructure and reliability engineering solutions.

Preferred

  • Experience supporting production-scale systems.

Compensation & Legal

  • $400 per accepted task
  • Compensation tied to accepted work.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
  • For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Creare un avviso di lavoro per questa ricerca

DevOps Engineer - AI Model Evaluator • Milan, Lombardy, Italy

Offerte simili

AI Engineer — Copilot Studio & Azure AI Lead

NadaraMilano, lombardia, Italy

Nadara is seeking an AI Engineer to design, build, and deploy AI solutions that enhance operational efficiency and drive AI transformation.This role involves leading AI initiatives, collaborating a... Mostra di più

 • In evidenza

GenAI Platforms Engineer — Real-Time ML Systems (Remote)

SkillvueMilano, lombardia, Italy

An HR tech startup is seeking an experienced ML Engineer to own end-to-end ML systems.You will design and maintain machine learning platforms tailored for skill assessments, collaborate closely wit... Mostra di più

 • In evidenza

Generative AI Engineer

ZURU ToysMilano, lombardia, Italy

ZURU Tech is on a mission to digitalize the construction process of buildings worldwide with innovative BIM software.We are a multinational team developing the first BIM solution that allows you to... Mostra di più

 • In evidenza

Continuous Improvement specialist - Addetto tempi e metodi

Randstad ItalyStradella, Lombardia, Italia

Hai una laurea in Ingegneria Gestionale e breve esperienza nell’analisi tempi e metodi maturata in contesti industriali?.Vuoi inserirti in un’importante azienda logistica con oltre 80.La divisione ... Mostra di più

 • In evidenza

AI Developer — NLP, Computer Vision & ML Engineer

PwC ItalyMilano, lombardia, Italy

Una società di consulenza globale è alla ricerca di un AI Developer per unirsi al team Digital Innovation.Il candidato ideale avrà una laurea in STEM e esperienza nello sviluppo di modelli di intel... Mostra di più

 • In evidenza

Agentic AI Engineer

Capgeminimilano, lombardia, Italy

Scegliere Capgemini significa scegliere un’azienda in cui sarà possibile plasmare la propria carriera nel modo desiderato, dove si sarà supportati e ispirati da una comunità collaborativa di colleg... Mostra di più

 • In evidenza

DevOps Engineer

TinventionMilano, lombardia, Italy

Quality Assurance (QA) e la produzione.In questo ruolo, sarai il punto di riferimento per l'automazione, la stabilità e la scalabilità dei nostri ambienti.Ti occuperai in particolare della progetta... Mostra di più

 • In evidenza

Remote RL Research Engineer - Cutting-Edge AI

JobgetherMilano, lombardia, Italy

Jobgether is seeking an AI Research Engineer specializing in Reinforcement Learning to work remotely in Milan, Italy.This position offers the opportunity to engage in cutting-edge AI research focus... Mostra di più

 • In evidenza

Senior AI Engineer (Agentic Systems)

Frontiere s.r.l.Milano, lombardia, Italy

Senior AI Engineer (Agentic Systems).From feasibility study and analysis of the market and trends, to operations management, through innovation, research and development, we help companies design, ... Mostra di più

 • In evidenza

AI Engineer — GenAI & Web Apps Innovator (Hybrid Remote)

BJR TechMilano, lombardia, Italy

A leading technology company in Milan is looking for a passionate AI Engineer to join their dedicated team.The role involves developing web applications using technologies like Python and Generativ... Mostra di più

 • In evidenza

AI Engineer

Lexroom.aiMilano, lombardia, Italy

AI—clear, fast, and built for trust.In just a few years, what began as an idea has become a reliable platform adopted by.We’re growing fast, backed by top-tier investors and a world-class team comm... Mostra di più

 • In evidenza

Applied AI Engineer, Robotics Evaluation - Mid

Cyberwave S.p.a.Milano, lombardia, Italy

Applied AI Engineer, Robotics Evaluation - Mid.Evaluate and improve AI-powered robotics workflows across simulations, edge devices, and real hardware.Build rigorous test plans, debug system behavio... Mostra di più

 • In evidenza

Applied AI Engineer, Robotics Evaluation - HIL

Cyberwave S.p.a.Milano, lombardia, Italy

Applied AI Engineer for robotics evaluation in Milan.The role includes evaluating AI-powered workflows, debugging system behavior, and ensuring product reliability.Candidates should have experience... Mostra di più

 • In evidenza

Remote Italian AI Data Annotator & Evaluator

CNTXT AIMilano, lombardia, Italy

CNTXT AI is seeking a fully remote contractor to support AI data and language projects.You will apply senior-level Italian localization and translation judgment with minimum C1 English proficiency ... Mostra di più

 • In evidenza

AI Research Engineer (Agentic Post-training)

JobgetherMilano, lombardia, Italy

This position is posted by Jobgether on behalf of a partner company.We are currently looking for an AI Research Engineer (Agentic Post-training) in Italy.This role sits at the frontier of large lan... Mostra di più

 • In evidenza

AI Engineer: LLM & Generative AI (Hybrid, Stock Options)

Clutch HRMilano, lombardia, Italy

Clutch HR sta cercando un AI Engineer per progettare e costruire sistemi AI all'avanguardia.La posizione prevede la gestione di pipeline ML, fine-tuning di LLM, e l'ottimizzazione di algoritmi NLP.... Mostra di più

 • In evidenza

AI Engineer

NadaraMilano, lombardia, Italy

We work harmoniously with the power of nature and the communities around us to power lifetimes to come.We call our approach ‘living energy’.We don’t just produce renewable energy, we live it – reco... Mostra di più

 • In evidenza

DevOps Engineer

ContentWise SpAMilano, lombardia, Italy

Digital media, entertainment, and e-commerce brands are investing in AI, predictive analytics and personalization technologies to offer a digital experience that is unique to each consumer.ContentW... Mostra di più