Talent.com
Mercor
AI Safety Specialist Evaluation ExpertMercor • Rome, Italy
AI Safety Specialist Evaluation Expert

AI Safety Specialist Evaluation Expert

Mercor • Rome, Italy
12 giorni fa
Descrizione dell’offerta di lavoro

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors include Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey.

Position: AI Safety Practitioner
Type: Contract
Compensation: $60$70/hour
Location: Remote

Role Responsibilities

  • Evaluate AI-generated responses for safety factual accuracy policy compliance and overall quality.
  • Review content involving misinformation political persuasion self-harm violence cyber biosecurity and other sensitive domains.
  • Apply and refine evaluation rubrics for RLHF SFT and AI safety benchmarking.
  • Identify unsafe outputs hallucinations reasoning failures and policy violations.
  • Provide structured feedback to improve model alignment and safety performance.
  • Collaborate with AI researchers and safety teams on ongoing evaluation initiatives.

Qualifications

Must-Have

  • Bachelors degree or higher in Journalism Communications Psychology Sociology Public Policy Law Biology Chemistry Computer Science or a related discipline.
  • 5 years of professional experience in AI Safety Trust & Safety journalism public policy scientific research security or a related field.
  • Excellent written English critical thinking and analytical reasoning skills.
  • Ability to consistently evaluate nuanced and policy-sensitive scenarios.

Preferred

  • Experience with AI Safety RLHF SFT Trust & Safety or AI evaluation.
  • Familiarity with safety policies content moderation or evaluation rubric development.
  • Experience reviewing complex high-risk or ambiguous content.

Application Process (Takes 2030 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information please check:
  • For any help or support reach out to:

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.


Employment Type : Full Time
Experience: years
Vacancy: 1

Creare un avviso di lavoro per questa ricerca

AI Safety Specialist Evaluation Expert • Rome, Italy

Offerte simili

Lead AI Engineer

IQVIARoma, lazio, Italy

In a world where information is instantly accessible, hospitals remain an exception.Electronic Health Record (EHR) systems are designed to support clinical workflows, but they often fall short when... Mostra di più

 • In evidenza

Senior EHS Consultant – Hybrid, M&A & Compliance

Ramboll Group A/SRoma, lazio, Italy

Ramboll Group A/S seeks an experienced Senior EHS Consultant in Italy, focusing on Environmental, Health & Safety due diligence and compliance projects for diverse clients.You will work with projec... Mostra di più

 • In evidenza

Health & Safety Specialist | Aeroporto di Fiumicino

Lagardère GroupFiumicino, lazio, Italy

La posizione supporta la funzione HSE nella gestione delle attività operative correlate alla sicurezza sul lavoro nell’ambito del perimetro italiano, affinché sia garantito il rispetto delle normat... Mostra di più

 • In evidenza

Lead AI Scientist

SoldoRoma, lazio, Italy

Soldo is the proactive spend management solution that frees progressive businesses to accomplish more.Over 25,000 organisations across 31 countries use Soldo to end slow, messy, and inefficient spe... Mostra di più

 • In evidenza

CQV Specialist - LIFE SCIENCE

ALTEN ItaliaRoma, lazio, Italy

Ruolo: CQV Specialist- LIFE SCIENCE.ALTEN supporta le strategie di sviluppo dei propri clienti nelle aree dell'innovazione, della R&D e dei sistemi informativi tecnologici.Nato più di 30 anni fa e ... Mostra di più

 • In evidenza

End-to-End International Logistics Specialist - Rome

Savino Del BeneFiumicino, lazio, Italy

Savino Del Bene cerca un/una Addetto/a alle Spedizioni Internazionali per la filiale di Roma.Il candidato sarà responsabile di gestire l'intero processo di spedizione, mantenendo i contatti con vet... Mostra di più

 • In evidenza

DIGITAL MARKETING SPECIALIST STAGE

Randstad ItalyNepi, Lazio, Italia

Hai esperienze nel Digital Marketing?.Cerchi un ambiente di lavoro inclusivo e improntato alla cordialità nei rapporti personali?.Randstad Italia, filiale di Monterotondo, ricerca per azienda leade... Mostra di più

 • In evidenza

Remote AI Safety Tester

TSMG HoldingRoma, lazio, Italy

A technology consulting firm is seeking a fully remote Project Evaluator for AI development.Responsibilities include generating requests and evaluating an AI agent's responses.The ideal candidate m... Mostra di più

 • In evidenza

Evaluation Scenario Writer - AI Agent Testing Specialist

MindriftRoma, lazio, Italy

Be among the first 25 applicants.This opportunity is only for candidates currently residing in the specified country.Your location may affect eligibility and rates.Please submit your resume in Engl... Mostra di più

 • In evidenza

Field Market Access Modeller Specialist

VantiveRoma, lazio, Italy

Vantive is a vital organ therapy company on a mission to extend lives and expand possibilities for patients and care teams everywhere.For 70 years, our team has driven meaningful innovations in kid... Mostra di più

 • In evidenza

Advisory & Audit Specialist - CPA/ACCA Ready

ITC WORLDWIDEFiumicino, lazio, Italy

A global professional services provider is seeking a Consultant in Fiumicino, Italy.This role involves understanding clients' needs, assessing risks, and preparing financial statements.Candidates m... Mostra di più

 • In evidenza

Advanced Italian AI Training Specialist — Remote & Flexible

Prolificroma, lazio, Italy

Prolific is seeking advanced Italian speakers to train and evaluate AI models.Responsibilities include completing tasks such as analyzing and editing in Italian, and judging AI performance.This pos... Mostra di più

 • In evidenza

Senior Model Validation Specialist - Risk & Quant Analytics

EuronextRoma, lazio, Italy

A financial services company in Rome is seeking a Model validation senior specialist to validate risk models used to measure various risks.This role requires a Master's degree in a quantitative fie... Mostra di più

 • In evidenza

EO AI Engineer — Agentic Earth Data Pipelines

Pi SchoolRoma, lazio, Italy

Pi School in Rome is seeking an EO AI Engineer to enhance EVE, an open-source AI platform for Earth Observation.You will work with satellite data and develop AI-powered agents to integrate EO data ... Mostra di più