Talent.com
Mercor
AI Safety Practitioner Expert EvaluatorMercor • Rome, Italy
AI Safety Practitioner Expert Evaluator

AI Safety Practitioner Expert Evaluator

Mercor • Rome, Italy
14 giorni fa
Descrizione dell’offerta di lavoro

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors include Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey.

Position: AI Safety Practitioner
Type: Contract
Compensation: $60$70/hour
Location: Remote

Role Responsibilities

  • Evaluate AI-generated responses for safety factual accuracy policy compliance and overall quality.
  • Review content involving misinformation political persuasion self-harm violence cyber biosecurity and other sensitive domains.
  • Apply and refine evaluation rubrics for RLHF SFT and AI safety benchmarking.
  • Identify unsafe outputs hallucinations reasoning failures and policy violations.
  • Provide structured feedback to improve model alignment and safety performance.
  • Collaborate with AI researchers and safety teams on ongoing evaluation initiatives.

Qualifications

Must-Have

  • Bachelors degree or higher in Journalism Communications Psychology Sociology Public Policy Law Biology Chemistry Computer Science or a related discipline.
  • 5 years of professional experience in AI Safety Trust & Safety journalism public policy scientific research security or a related field.
  • Excellent written English critical thinking and analytical reasoning skills.
  • Ability to consistently evaluate nuanced and policy-sensitive scenarios.

Preferred

  • Experience with AI Safety RLHF SFT Trust & Safety or AI evaluation.
  • Familiarity with safety policies content moderation or evaluation rubric development.
  • Experience reviewing complex high-risk or ambiguous content.

Application Process (Takes 2030 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information please check:
  • For any help or support reach out to:

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.


Employment Type : Full Time
Experience: years
Vacancy: 1

Creare un avviso di lavoro per questa ricerca

AI Safety Practitioner Expert Evaluator • Rome, Italy

Offerte simili

Lead AI Engineer

IQVIARoma, lazio, Italy

In a world where information is instantly accessible, hospitals remain an exception.Electronic Health Record (EHR) systems are designed to support clinical workflows, but they often fall short when... Mostra di più

 • In evidenza

Product Marketer, AI solutions

Pi SchoolRoma, lazio, Italy

Pi School empowers businesses and professionals to leverage AI’s transformative capabilities.We believe technology should enable growth, innovation, and connectivity for individuals and organisatio... Mostra di più

 • In evidenza

Postdoc: AI Agents for Lab-Driven Science

EMBLRoma, lazio, Italy

A leading research institute in Italy is seeking a researcher to design and build agentic AI systems for life-science discovery.The role involves evaluating models in laboratory workflows and publi... Mostra di più

 • In evidenza

Senior AI Engineer – LLMs & Agentic Systems - Freelance

ShakersRoma, lazio, Italy

AI consultancy working on advanced, real-world projects around.AI solutions, not demos or PoCs.DBs, chunking strategies, retrieval & ranking).Developing APIs and services in.OpenAI / Azure OpenAI /... Mostra di più

 • In evidenza

Senior AI Engineer

Bip ItaliaRoma - Italy

Questa posizione è in Bip Italia.Riassunto dell'opportunità da parte della.Bip Italia cerca un Senior AI Engineer con laurea specialistica in Ingegneria Informatica, Data Science, Informatica o dis... Mostra di più

 • In evidenza

Senior Consultant - AI & Advanced Technology

Marsh McLennanRome - Italy

Questa posizione è in Marsh McLennan.Il processo di selezione sarà interamente gestito Marsh McLennan.Senior Consultant - AI & Advanced technology.Group, a group of expertise in strategic and manag... Mostra di più

Freelance Cybersecurity Analyst - AI Trainer

MindriftRoma, lazio, Italy

Freelance Cybersecurity Analyst - AI Trainer.Be among the first 25 applicants.Get AI-powered advice on this job and more exclusive features.This opportunity is only for candidates currently residin... Mostra di più

 • In evidenza

AI Solutions Product Marketer

Pi SchoolRoma, lazio, Italy

Pi School in Rome seeks a Product Marketer, AI Solutions, to translate AI capabilities into market-ready offerings and revenue opportunities.You’ll bridge marketing and sales, shaping positioning, ... Mostra di più

 • In evidenza

Freelance AI Architect & Trainer — Remote (EU/UK)

10x.TeamRoma, lazio, Italy

Team is seeking an experienced AI Architect – AI Trainer for a remote, EU/UK freelance engagement.AI models while collaborating with labs and researchers.You will review AI outputs, assess architec... Mostra di più

 • In evidenza

Remote Freelance Cybersecurity Analyst & AI Tutor

MindriftRoma, lazio, Italy

A tech innovation company is looking for a Freelance Cybersecurity Analyst - AI Trainer.This remote part-time position requires advanced knowledge in cybersecurity and at least 3 years of experienc... Mostra di più

 • In evidenza

Remote AI Safety Tester

TSMG HoldingRoma, lazio, Italy

A technology consulting firm is seeking a fully remote Project Evaluator for AI development.Responsibilities include generating requests and evaluating an AI agent's responses.The ideal candidate m... Mostra di più

 • In evidenza

Senior AI Engineer - Google...

Bip ItaliaRoma - Italy, IT

Questa posizione è in Bip Italia Riassunto dell'opportunità da parte della Joinrs AI: Bip Italia cerca un AI Engineer con laurea in Ingegneria Informatica, Data Science o discipline STEM.Il ruolo ... Mostra di più

 • In evidenza

Economics AI Trainer (Part-Time, Remote)

MindriftRoma, lazio, Italy

A global AI innovation firm is seeking entry-level contributors for part-time remote projects in economics.Candidates should be final-year undergraduates or postgraduates with strong academic recor... Mostra di più

 • In evidenza

Threat Detection & Response Expert

AccentureRome - Italy

Questa posizione è in Accenture.Riassunto dell'opportunità da parte della.I candidati ideali contribuiranno a sviluppare e gestire soluzioni tecnologiche avanzate per l’identificazione e la rispost... Mostra di più

 • In evidenza

Evaluation Scenario Writer - AI Agent Testing Specialist

MindriftRoma, lazio, Italy

Be among the first 25 applicants.This opportunity is only for candidates currently residing in the specified country.Your location may affect eligibility and rates.Please submit your resume in Engl... Mostra di più

 • In evidenza

Remote Physics QA Lead for AI Training

YO IT ConsultingRoma, lazio, Italy

Physics Quality Assurance Lead.In this hourly, remote contractor role, you will work as a Physics Quality Assurance Lead to oversee quality, consistency, and trainer performance across physics AI t... Mostra di più

 • In evidenza

Earth Observation AI Engineer

Pi SchoolRoma, lazio, Italy

Pi School is on a mission to empower businesses and professionals to leverage AI’s transformative capabilities.We believe technology should be an enabler, not a barrier, and it should empower indiv... Mostra di più

 • In evidenza

Senior AI Engineer (Agentic Systems)

Frontiere s.r.l.Roma, lazio, Italy

Senior AI Engineer (Agentic Systems).From feasibility study and analysis of the market and trends, to operations management, through innovation, research and development, we help companies design, ... Mostra di più

 • In evidenza

AI Recruitment Specialist (Freelance, Remote, EU/UK)

10x.TeamRoma, lazio, Italy

Team seeks a Freelance AI Trainer for Talent Acquisition with 8–20 hours per week, fully remote for EU/UK experts.You will review AI content on recruitment, provide actionable feedback, and craft r... Mostra di più

 • In evidenza

Senior AI Engineer - Hybrid LLMs & Agentic Systems

ShakersRoma, lazio, Italy

A leading AI consultancy in Italy is seeking a Senior AI Engineer to design and build production-grade AI solutions.In this hands-on role, you will work with agentic AI systems and LLMs alongside a... Mostra di più