Talent.com
Mercor
AI Safety Specialist - Evaluation ExpertMercor • Milan, Lombardy, Italy
AI Safety Specialist - Evaluation Expert

AI Safety Specialist - Evaluation Expert

Mercor • Milan, Lombardy, Italy
4 ore fa
Tipo di contratto
  • Remoto
  • Quick Apply
Descrizione dell’offerta di lavoro

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: AI Safety Practitioner
Type: Contract
Compensation: $60–$70/hour
Location: Remote

Role Responsibilities

  • Evaluate AI-generated responses for safety, factual accuracy, policy compliance, and overall quality.
  • Review content involving misinformation, political persuasion, self-harm, violence, cyber, biosecurity, and other sensitive domains.
  • Apply and refine evaluation rubrics for RLHF, SFT, and AI safety benchmarking.
  • Identify unsafe outputs, hallucinations, reasoning failures, and policy violations.
  • Provide structured feedback to improve model alignment and safety performance.
  • Collaborate with AI researchers and safety teams on ongoing evaluation initiatives.

Qualifications

Must-Have

  • Bachelor's degree or higher in Journalism, Communications, Psychology, Sociology, Public Policy, Law, Biology, Chemistry, Computer Science, or a related discipline.
  • 5+ years of professional experience in AI Safety, Trust & Safety, journalism, public policy, scientific research, security, or a related field.
  • Excellent written English, critical thinking, and analytical reasoning skills.
  • Ability to consistently evaluate nuanced and policy-sensitive scenarios.

Preferred

  • Experience with AI Safety, RLHF, SFT, Trust & Safety, or AI evaluation.
  • Familiarity with safety policies, content moderation, or evaluation rubric development.
  • Experience reviewing complex, high-risk, or ambiguous content.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
  • For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Creare un avviso di lavoro per questa ricerca

AI Safety Specialist - Evaluation Expert • Milan, Lombardy, Italy

Offerte simili

Experienced Professional | AI & Strategy Expert

JAKALAMilano, lombardia, Italy

JAKALA è un'azienda che lavora su dati, intelligenza artificiale e sviluppo di esperienze per generare un impatto significativo e duraturo a livello globale.Presenti in oltre 30 città in 21 paesi, ... Mostra di più

 • In evidenza

EHS Specialist: Safety, Compliance & Environment

ALSTOM Gruppesesto san giovanni, lombardia, Italy

Alstom is seeking an EHS Specialist in Lombardy to ensure a safe environment for employees and contractors on construction sites and projects.You will support risk assessments, emergency plans, and... Mostra di più

 • In evidenza

Strategic Lead, Product Engineering – Safety Systems

Michael Page International Italia S.r.l.Monza, lombardia, Italy

Michael Page International Italia S.Head of Product Engineering per gestire il portafoglio prodotti in un'azienda industriale focalizzata su sistemi di sicurezza meccanici.La risorsa avrà la respon... Mostra di più

 • In evidenza

Senior AI Engineer

DGS S.P.A.Sesto San Giovanni, lombardia, Italy

Cyber Security, Digital Solutions e Management Consulting.Lo scopo che guida le nostre azioni è il pieno soddisfacimento delle esigenze del cliente, garantendo sempre l’assoluta eccellenza delle so... Mostra di più

 • In evidenza

Continuous Improvement specialist - Addetto tempi e metodi

Randstad ItalyStradella, Lombardia, Italia

Hai una laurea in Ingegneria Gestionale e breve esperienza nell’analisi tempi e metodi maturata in contesti industriali?.Vuoi inserirti in un’importante azienda logistica con oltre 80.La divisione ... Mostra di più

 • In evidenza

Junior Health Innovation Strategist | Digital Health & AI

Define VenturesMilano, lombardia, Italy

Define Ventures is looking for a Junior Strategist to join their EVERSANA INTOUCH Health Innovation team.In this role, you will support strategic initiatives in health innovation and digital health... Mostra di più

 • In evidenza

Remote Contaminated Site Specialist: Risk & Remediation

Seeds Renewablesmilano, lombardia, Italy

A leading environmental consultancy in Milan is seeking a technically skilled Consultant Technical Specialist to support contaminated site management projects.The ideal candidate will have hands-on... Mostra di più

 • In evidenza

AI Engineer

Lexroom.aiMilano, lombardia, Italy

AI—clear, fast, and built for trust.In just a few years, what began as an idea has become a reliable platform adopted by.We’re growing fast, backed by top-tier investors and a world-class team comm... Mostra di più

 • In evidenza

Environmental Consultant – Site Investigation & Remediation (Field focus)

ERMMilano, lombardia, Italy

Consultant with a passion for sustainability to join our growing Site Investigation & Remediation (SIR) Team in Italy.The role will be a mixed of on‑site (primarily) and desk‑job.Our offices are ba... Mostra di più

 • In evidenza

Remote Italian AI Data Annotator & Evaluator

CNTXT AIMilano, lombardia, Italy

CNTXT AI is seeking a fully remote contractor to support AI data and language projects.You will apply senior-level Italian localization and translation judgment with minimum C1 English proficiency ... Mostra di più

 • In evidenza

Integrator Engineer – Risk Systems, Europe Travel

Risk Systems Consultingmilano, lombardia, Italy

A consulting firm specializing in Risk Management is seeking an Integrator Engineer to deliver technical solutions for key clients in Italy.The role involves setting up complex systems and developi... Mostra di più

 • In evidenza

AI Engineer Intern: FMEA Automation & Avionics AI

ThalesGorgonzola, lombardia, Italy

Thales in Gorgonzola, Italy, is looking for an AI Intern to assist with developing an innovative AI tool aimed at automating the initial drafting of FMEA reports.The ideal candidate will have stron... Mostra di più

 • In evidenza

Senior AI Engineer

DGSsesto san giovanni, lombardia, Italy

In DGS il talento diventa impatto perché entra in progetti reali, dove competenze tecnologiche, visione di business e collaborazione si incontrano per accompagnare aziende e organizzazioni nei loro... Mostra di più

 • In evidenza

Pharmacovigilance Specialist: Drug Safety & Compliance

ACS DOBFARagrate brianza, lombardia, Italy

ACS DOBFAR is looking for a Drug Safety Officer in Agrate Brianza, Italy.The ideal candidate will ensure compliance with pharmacovigilance guidelines, manage data entry of adverse event reports, an... Mostra di più

 • In evidenza

TECHNICAL QUOTING SPECIALIST – AVIONICS & AEROSPACE

Ali ProfessionalLomagna, lombardia, Italy

Ali Professional is looking for a.The selected candidate will join the Quoting team, supporting the sourcing and costing activities required to prepare commercial offers for new business opportunit... Mostra di più

 • In evidenza

AI-Enabled Red Team & Penetration Testing Lead Senior

Intesa SanpaoloMilano, lombardia, Italy

Entrerai a far parte del team di Offensive Security & Attack Surface, e sarai responsabile di evolvere il modello di Offensive Security tradizionale verso un paradigma AI-augmented e industrializza... Mostra di più

 • In evidenza

Remote HSE Specialist: Safety, Compliance & Training

QabirdMilano, lombardia, Italy

Qabird in Milano is seeking an HSE Specialist with solid expertise in health and safety.The ideal candidate will demonstrate strong knowledge of MS Office and be business fluent in English, equippe... Mostra di più

 • In evidenza

AI-Driven Tender Engagement Lead

FBK s.r.l.Milano, lombardia, Italy

Engagement Manager in Milan to lead customer onboarding and ongoing engagement for our AI-powered tender platform.You will coordinate implementation projects, gather requirements, and drive adoptio... Mostra di più

 • In evidenza

AI Innovation Strategist — Global Tech Scouting & Strategy

Fincons Groupvimercate, lombardia, Italy

Un importante gruppo di consulenza IT a Vimercate cerca un Technology AI Innovation Strategist.La figura supporterà l'Hub di Innovazione con scouting tecnologico e analisi del mercato, monitorando... Mostra di più

 • In evidenza

Identity Security Expert

Accenture ItaliaMilano, lombardia, Italy

Cyber Protection Expert - Identity and Access Management.Cyber Protection Expert - Identity and Access Management.Be among the first 25 applicants.Cyber Protection Expert - Identity and Access Mana... Mostra di più