3 days ago Be among the first 25 applicants
L'esperienza richiesta ai candidati, così come le competenze e le qualifiche aggiuntive necessarie per questo lavoro, sono elencate di seguito.
This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English.
At Mindrift, innovation meets opportunity. We believe in using the power of collective human intelligence to ethically shape the future of AI.
What We Do
The Mindrift platform, launched and powered by Toloka, connects domain experts with cutting-edge AI projects from innovative tech clients. Our mission is to unlock the potential of GenAI by tapping into real-world expertise from across the globe.
About The Role
We're looking for someone who can design realistic and structured evaluation scenarios for LLM-based agents. You'll create test cases that simulate human-performed tasks and define gold‑standard behavior to compare agent actions against. You'll work to ensure each scenario is clearly defined, well‑scored, and easy to execute and reuse. You'll need a sharp analytical mindset, attention to detail, and an interest in how AI agents make decisions.
Responsibilities
How To Get Started
Simply apply to this post, qualify, and get the chance to contribute to projects aligned with your skills, on your own schedule. From creating training prompts to refining model responses, you'll help shape the future of AI while ensuring technology benefits everyone.
Requirements
Nice to Have
Benefits
Seniority level
Entry level
Employment type
Part‑time
Job function
Other
Industries
IT Services and IT Consulting
#J-18808-Ljbffr
Evaluation Scenario Writer - AI Agent Testing Specialist • Roma, Italy
A leading research institute in Italy is seeking a researcher to design and build agentic AI systems for life-science discovery.The role involves evaluating models in laboratory workflows and publi... Mostra di più
A leading AI consultancy in Italy is seeking a Senior AI Engineer to design and build production-grade AI solutions.In this hands-on role, you will work with agentic AI systems and LLMs alongside a... Mostra di più
Join to apply for the bLead AI Engineer /b role at bIQVIA /b.About IQVIA Patient Finder /h3 pIn a world where information is instantly accessible, hospitals remain an exception.Electronic Health Re... Mostra di più
PwC Italy cerca un Senior AI Developer per il suo AI Center of Excellence a Roma.Il candidato sarà coinvolto nello sviluppo di applicazioni innovative basate su intelligenza artificiale, culminando... Mostra di più
Una società di consulenza globale cerca un AI Developer per sviluppare applicazioni innovative basate su tecnologie di intelligenza artificiale.Il candidato ideale possiede una laurea in discipline... Mostra di più
A technology company in Italy is seeking an experienced AI Integration Specialist to design and implement functions for AI agents across multiple channels such as voice, chat, and email.The ideal c... Mostra di più
Pi School in Rome seeks a Product Marketer, AI Solutions, to translate AI capabilities into market-ready offerings and revenue opportunities.You’ll bridge marketing and sales, shaping positioning, ... Mostra di più
Torino, Italia cerca un AI Product Owner per guidare progetti di AI e trasformazione digitale.Avrai responsabilità sulla definizione e gestione della roadmap di prodotto basata su soluzioni AI, rac... Mostra di più
Team is seeking an experienced AI Architect – AI Trainer for a remote, EU/UK freelance engagement.AI models while collaborating with labs and researchers.You will review AI outputs, assess architec... Mostra di più
STIP SRL Roma, Italia Senior AI Engineer /p h3Descrizione azienda /h3 pbStip AI /bsta trasformando il modo in cui le aziende interagiscono con i propri clienti attraverso tecnologie di Intelligenz... Mostra di più
A financial technology company in Rome is seeking a Lead AI Scientist to build and lead its AI research team.This role involves defining the AI strategy, mentoring staff, and ensuring effective col... Mostra di più
Questa posizione è in Bip Italia Riassunto dell'opportunità da parte della Joinrs AI: Bip Italia cerca un AI Engineer con laurea in Ingegneria Informatica, Data Science o discipline STEM.Il ruolo ... Mostra di più
Pi School in Rome is seeking an EO AI Engineer to enhance EVE, an open-source AI platform for Earth Observation.You will work with satellite data and develop AI-powered agents to integrate EO data ... Mostra di più
Team seeks a Freelance AI Trainer for Talent Acquisition with 8–20 hours per week, fully remote for EU/UK experts.You will review AI content on recruitment, provide actionable feedback, and craft r... Mostra di più
Shopfully in Rome is seeking a Senior Finance Automation Architect.This role is pivotal in designing AI-driven solutions for Finance, focusing on intelligent automation and machine learning.The ide... Mostra di più
Overview /h3pIn ottica di crescita ed espansione continua, siamo alla ricerca di un bAI ENGINEER /b per un Cliente leader nel settore Aerospazio Difesa.La risorsa sarà inserita presso il team prog... Mostra di più
A global professional services provider is seeking a Consultant in Fiumicino, Italy.This role involves understanding clients' needs, assessing risks, and preparing financial statements.Candidates m... Mostra di più
We’re looking for a bSenior AI Engineer /b to join a high-impact AI consultancy working on advanced, real-world projects around bLLMs and multi-agent systems /b.This is a bvery hands-on role /b, fo... Mostra di più
Prolific is seeking advanced Italian speakers to train and evaluate AI models.Responsibilities include completing tasks such as analyzing and editing in Italian, and judging AI performance.This pos... Mostra di più
Questa posizione è in Capgemini.Il processo di selezione sarà interamente gestito Capgemini.Questa opportunità è disponibile in Rome - Italy, Milan - Italy.At Capgemini Invent, we believe differenc... Mostra di più
