Talent.com
Mercor
AI Safety Practitioner - Expert EvaluatorMercor • Milan, Lombardy, Italy
AI Safety Practitioner - Expert Evaluator

AI Safety Practitioner - Expert Evaluator

Mercor • Milan, Lombardy, Italy
9 ore fa
Tipo di contratto
  • Remoto
  • Quick Apply
Descrizione dell’offerta di lavoro

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: AI Safety Practitioner
Type: Contract
Compensation: $60–$70/hour
Location: Remote

Role Responsibilities

  • Evaluate AI-generated responses for safety, factual accuracy, policy compliance, and overall quality.
  • Review content involving misinformation, political persuasion, self-harm, violence, cyber, biosecurity, and other sensitive domains.
  • Apply and refine evaluation rubrics for RLHF, SFT, and AI safety benchmarking.
  • Identify unsafe outputs, hallucinations, reasoning failures, and policy violations.
  • Provide structured feedback to improve model alignment and safety performance.
  • Collaborate with AI researchers and safety teams on ongoing evaluation initiatives.

Qualifications

Must-Have

  • Bachelor's degree or higher in Journalism, Communications, Psychology, Sociology, Public Policy, Law, Biology, Chemistry, Computer Science, or a related discipline.
  • 5+ years of professional experience in AI Safety, Trust & Safety, journalism, public policy, scientific research, security, or a related field.
  • Excellent written English, critical thinking, and analytical reasoning skills.
  • Ability to consistently evaluate nuanced and policy-sensitive scenarios.

Preferred

  • Experience with AI Safety, RLHF, SFT, Trust & Safety, or AI evaluation.
  • Familiarity with safety policies, content moderation, or evaluation rubric development.
  • Experience reviewing complex, high-risk, or ambiguous content.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
  • For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Creare un avviso di lavoro per questa ricerca

AI Safety Practitioner - Expert Evaluator • Milan, Lombardy, Italy

Offerte simili

ML/AI Expert

Reputation Manager S.p.A.milano, lombardia, Italy

In previsione di un ampliamento interno della divisione IT ricerchiamo unb ESPERTO IN MATERIA DI ARTIFICIAL INTELIGENCE/MACHINE LEARNING.Il candidato verrà inserito in un team di esperti composto d... Mostra di più

 • In evidenza

Senior AI Engineer - Tech Lead

BJR TechMilano, lombardia, Italy

We are looking for a Senior AI Engineer - Tech Lead to assistus in building exceptional web applications.Join us to transform ideas into high-quality products! This challenging and rewarding task w... Mostra di più

 • In evidenza

AI Engineer — Copilot Studio & Azure AI Lead

NadaraMilano, lombardia, Italy

Nadara is seeking an AI Engineer to design, build, and deploy AI solutions that enhance operational efficiency and drive AI transformation.This role involves leading AI initiatives, collaborating a... Mostra di più

 • In evidenza

AI Platform Engineer

TeamSystemMilano - Italy

Questa posizione è in TeamSystem.Il processo di selezione sarà interamente gestito TeamSystem.Questa opportunità è disponibile in Milano - Italy, Padova - Italy.How? By putting customers first and ... Mostra di più

Agile Practitioner – Entry Level

BIPMilano, lombardia, Italy

Agile Practitioner – Entry Level.Cerchiamo una figura entusiasta e proattiva che preferisca relazionarsi con le persone piuttosto che focalizzarsi su strumenti e processi, con la curiosità di speri... Mostra di più

 • In evidenza

AI Engineer

BJR TechMilano, lombardia, Italy

We are looking for an AI Engineer to assist us in building exceptional web applications.Join us to transform ideas into high-quality products! This challenging and rewarding task will see you worki... Mostra di più

 • In evidenza

Remote Italian AI Data Annotator & Evaluator

CNTXT AImilano, lombardia, Italy

CNTXT AI is seeking a fully remote contractor to support AI data and language projects.You will apply senior-level Italian localization and translation judgment with minimum C1 English proficiency ... Mostra di più

 • In evidenza

Associate –Tech & AI

McKinsey & Company, Inc.Milano, lombardia, Italy

Do you want to do work that matters, alongside supportive leaders who will help you grow faster than you ever thought possible? Are you a creative problem‑solver who is energized by challenges?.You... Mostra di più

 • In evidenza

Agentic AI Engineer

CapgeminiMilano, lombardia, Italy

Scegliere Capgemini significa scegliere un’azienda in cui sarà possibile plasmare la propria carriera nel modo desiderato, dove si sarà supportati e ispirati da una comunità collaborativa di colleg... Mostra di più

 • In evidenza

Junior Health Innovation Strategist | Digital Health & AI

Define VenturesMilano, lombardia, Italy

Define Ventures is looking for a Junior Strategist to join their EVERSANA INTOUCH Health Innovation team.In this role, you will support strategic initiatives in health innovation and digital health... Mostra di più

 • In evidenza

Senior AI Engineer (Agentic Systems)

Frontiere s.r.l.Milano, lombardia, Italy

Senior AI Engineer (Agentic Systems).From feasibility study and analysis of the market and trends, to operations management, through innovation, research and development, we help companies design, ... Mostra di più

 • In evidenza

AI Engineer, Italy

Wonderful Ltd.milano, lombardia, Italy

Wonderful enables enterprises to build, test, deploy, and monitor AI agents for their most complex needs, serving customers and employees seamlessly across voice, chat, email, and back-office syste... Mostra di più

 • In evidenza

AI Engineer

Lexroom.aiMilano, lombardia, Italy

AI—clear, fast, and built for trust.In just a few years, what began as an idea has become a reliable platform adopted by.We’re growing fast, backed by top-tier investors and a world-class team comm... Mostra di più

 • In evidenza

Applied AI Engineer, Robotics Evaluation - Mid

Cyberwave S.p.a.Milano, lombardia, Italy

Applied AI Engineer, Robotics Evaluation - Mid.Evaluate and improve AI-powered robotics workflows across simulations, edge devices, and real hardware.Build rigorous test plans, debug system behavio... Mostra di più

 • In evidenza

AI-Enabled Red Team & Penetration Testing Lead Senior

Intesa Sanpaolo Groupmilano, lombardia, Italy

Località: Milano - Torino, IT /p pSocietà: Intesa Sanpaolo S.Entrerai a far parte del team di Offensive Security Attack Surface, e sarai responsabile di evolvere il modello di Offensive Security t... Mostra di più

 • In evidenza

AI Engineer Intern: FMEA Automation & Avionics AI

ThalesGorgonzola, lombardia, Italy

Thales in Gorgonzola, Italy, is looking for an AI Intern to assist with developing an innovative AI tool aimed at automating the initial drafting of FMEA reports.The ideal candidate will have stron... Mostra di più

 • In evidenza

AI-Enabled Red Team & Penetration Testing Lead Senior

Intesa SanpaoloMilano, lombardia, Italy

Entrerai a far parte del team di Offensive Security & Attack Surface, e sarai responsabile di evolvere il modello di Offensive Security tradizionale verso un paradigma AI-augmented e industrializza... Mostra di più

 • In evidenza

Detection Researcher/Security Engineer (iOS Focused)

ZimperiumMilano, lombardia, Italy

Zimperium® is the world leader in mobile security, purpose-built to protect the modern mobile enterprise.Trusted by leading organizations and governments, our AI-driven platform delivers real-time,... Mostra di più

 • In evidenza

AI-Driven Tender Engagement Lead

FBK s.r.l.Milano, lombardia, Italy

Engagement Manager in Milan to lead customer onboarding and ongoing engagement for our AI-powered tender platform.You will coordinate implementation projects, gather requirements, and drive adoptio... Mostra di più

 • In evidenza

Engagement Manager - Tech & AI

McKinsey & Company ItalyMilan - Italy

Questa posizione è in McKinsey & Company Italy.Il processo di selezione sarà interamente gestito McKinsey & Company Italy.Driving lasting impact and building long-term capabilities with our clients... Mostra di più