Talent.com
Mercor
AI Safety Specialist - Evaluation ExpertMercor • Rome, Lazio, Italy
AI Safety Specialist - Evaluation Expert

AI Safety Specialist - Evaluation Expert

Mercor • Rome, Lazio, Italy
19 ore fa
Tipo di contratto
  • Remoto
  • Quick Apply
Descrizione dell’offerta di lavoro

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: AI Safety Practitioner
Type: Contract
Compensation: $60–$70/hour
Location: Remote

Role Responsibilities

  • Evaluate AI-generated responses for safety, factual accuracy, policy compliance, and overall quality.
  • Review content involving misinformation, political persuasion, self-harm, violence, cyber, biosecurity, and other sensitive domains.
  • Apply and refine evaluation rubrics for RLHF, SFT, and AI safety benchmarking.
  • Identify unsafe outputs, hallucinations, reasoning failures, and policy violations.
  • Provide structured feedback to improve model alignment and safety performance.
  • Collaborate with AI researchers and safety teams on ongoing evaluation initiatives.

Qualifications

Must-Have

  • Bachelor's degree or higher in Journalism, Communications, Psychology, Sociology, Public Policy, Law, Biology, Chemistry, Computer Science, or a related discipline.
  • 5+ years of professional experience in AI Safety, Trust & Safety, journalism, public policy, scientific research, security, or a related field.
  • Excellent written English, critical thinking, and analytical reasoning skills.
  • Ability to consistently evaluate nuanced and policy-sensitive scenarios.

Preferred

  • Experience with AI Safety, RLHF, SFT, Trust & Safety, or AI evaluation.
  • Familiarity with safety policies, content moderation, or evaluation rubric development.
  • Experience reviewing complex, high-risk, or ambiguous content.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
  • For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Creare un avviso di lavoro per questa ricerca

AI Safety Specialist - Evaluation Expert • Rome, Lazio, Italy

Offerte simili

Lead AI Engineer

IQVIARoma, lazio, Italy

In a world where information is instantly accessible, hospitals remain an exception.Electronic Health Record (EHR) systems are designed to support clinical workflows, but they often fall short when... Mostra di più

 • In evidenza

ENVIRONMENTAL ASSET OPERATIONS SPECIALIST

ADRroma, lazio, Italy

Il Gruppo Aeroporti di Roma, all’interno della Business Unit Aviation nell’unità organizzativa Asset Operation Maintenance Ciampino è alla ricerca di: /p h3Environmental Asset Operations Specialis... Mostra di più

 • In evidenza

Senior EHS Consultant – Hybrid, M&A & Compliance

Ramboll Group A/SRoma, lazio, Italy

Ramboll Group A/S seeks an experienced Senior EHS Consultant in Italy, focusing on Environmental, Health & Safety due diligence and compliance projects for diverse clients.You will work with projec... Mostra di più

 • In evidenza

Senior AI Engineer: NLP, Vision & ML

PwC ItalyRoma, lazio, Italy

PwC Italy cerca un Senior AI Developer per il suo AI Center of Excellence a Roma.Il candidato sarà coinvolto nello sviluppo di applicazioni innovative basate su intelligenza artificiale, culminando... Mostra di più

 • In evidenza

Health & Safety Specialist | Aeroporto di Fiumicino

Lagardère GroupFiumicino, lazio, Italy

La posizione supporta la funzione HSE nella gestione delle attività operative correlate alla sicurezza sul lavoro nell’ambito del perimetro italiano, affinché sia garantito il rispetto delle normat... Mostra di più

 • In evidenza

Lead AI Scientist

SoldoRoma, lazio, Italy

Soldo is the proactive spend management solution that frees progressive businesses to accomplish more.Over 25,000 organisations across 31 countries use Soldo to end slow, messy, and inefficient spe... Mostra di più

 • In evidenza

CQV Specialist - LIFE SCIENCE

ALTEN ItaliaRoma, lazio, Italy

Ruolo: CQV Specialist- LIFE SCIENCE.ALTEN supporta le strategie di sviluppo dei propri clienti nelle aree dell'innovazione, della R&D e dei sistemi informativi tecnologici.Nato più di 30 anni fa e ... Mostra di più

 • In evidenza

EHS Consultant EHS Consultant Ramboll Management Consulting Hybrid · Rome, Lazio, IT about 5 ho[...]

Seeds RenewablesRoma, lazio, Italy

Ramboll Management Consulting – Hybrid – Rome, Lazio, IT.We are looking for a Senior Environmental, Health & Safety (EHS) Consultant to support Environmental, Health & Safety Due Diligence and Comp... Mostra di più

 • In evidenza

Senior Model Validation Specialist - Risk & Quant Analytics

Euronextroma, lazio, Italy

A financial services company in Rome is seeking a Model validation senior specialist to validate risk models used to measure various risks.This role requires a Master's degree in a quantitative fie... Mostra di più

 • In evidenza

DIGITAL MARKETING SPECIALIST STAGE

Randstad ItalyNepi, Lazio, Italia

Hai esperienze nel Digital Marketing?.Cerchi un ambiente di lavoro inclusivo e improntato alla cordialità nei rapporti personali?.Randstad Italia, filiale di Monterotondo, ricerca per azienda leade... Mostra di più

 • In evidenza

Remote AI Safety Tester

TSMG HoldingRoma, lazio, Italy

A technology consulting firm is seeking a fully remote Project Evaluator for AI development.Responsibilities include generating requests and evaluating an AI agent's responses.The ideal candidate m... Mostra di più

 • In evidenza

Evaluation Scenario Writer - AI Agent Testing Specialist

MindriftRoma, lazio, Italy

Be among the first 25 applicants.This opportunity is only for candidates currently residing in the specified country.Your location may affect eligibility and rates.Please submit your resume in Engl... Mostra di più

 • In evidenza

Field Market Access Modeller Specialist

VantiveRoma, lazio, Italy

Vantive is a vital organ therapy company on a mission to extend lives and expand possibilities for patients and care teams everywhere.For 70 years, our team has driven meaningful innovations in kid... Mostra di più

 • In evidenza

Earth Observation AI Engineer

Pi SchoolRoma, lazio, Italy

Pi School is on a mission to empower businesses and professionals to leverage AI’s transformative capabilities.We believe technology should be an enabler, not a barrier, and it should empower indiv... Mostra di più

 • In evidenza

Artificial Intelligence Specialist

Pacini Grouproma, lazio, Italy

Overview /h3 pPacini Group, Real Estate Advisory, Hospitality Development Hotel Management, da oltre 20 anni realizza progetti unici e di ispirazione nel mondo dell’ospitalità con un approccio mul... Mostra di più

 • In evidenza

Aerospace RAMS & ILS Engineer | Lead Reliability & Safety

Accenture Italiaroma, lazio, Italy

Una delle principali aziende di consulenza globale cerca un professionista in Engineering per gestire attività RAMS nel settore Aerospace Defense.Il candidato ideale avrà una laurea in Ingegneria ... Mostra di più

 • In evidenza

Advisory & Audit Specialist - CPA/ACCA Ready

ITC WORLDWIDEFiumicino, lazio, Italy

A global professional services provider is seeking a Consultant in Fiumicino, Italy.This role involves understanding clients' needs, assessing risks, and preparing financial statements.Candidates m... Mostra di più

 • In evidenza

Advanced Italian AI Training Specialist — Remote & Flexible

Prolificroma, lazio, Italy

Prolific is seeking advanced Italian speakers to train and evaluate AI models.Responsibilities include completing tasks such as analyzing and editing in Italian, and judging AI performance.This pos... Mostra di più

 • In evidenza

EO AI Engineer — Agentic Earth Data Pipelines

Pi SchoolRoma, lazio, Italy

Pi School in Rome is seeking an EO AI Engineer to enhance EVE, an open-source AI platform for Earth Observation.You will work with satellite data and develop AI-powered agents to integrate EO data ... Mostra di più

 • In evidenza

Environmental Specialist - P.Iva

Michael PageRoma, lazio, Italy

Per azienda leader nel settore Ingegneria Civile, Ambientale e Marittima, siamo alla ricerca di un/una Ing.Ambientale/Geologo da inserire nel team di Roma come Specialista Ambientale per la progett... Mostra di più