Research Engineer (Evals)

WhitecircleParis, FrancePosted 2h agoonsite

TLDR: We're looking for a research engineer to build and maintain our internal suite of benchmarks, covering single/multi-turn content and agentic guardrails. The research engineer would also work with the team on projects studying agent behaviours in the wild.

About us

White Circle is an AI Safety company building the safety, reliability, and optimization layer for AI systems. At the core of our platform are policies – simple natural-language rules that define what an AI model should and shouldn’t do. We automatically test, enforce, and continuously improve these policies at scale.

We’ve raised $11M from top funds, founders, and senior leaders at OpenAI, Anthropic, HuggingFace, Mistral, DeepMind, Datadog, Sentry, and others
We process over 100M+ API calls every month
We fine-tune and train our own LLMs so they run faster and cheaper than any open or proprietary model

We’re a small, highly focused team. If you want to work deeply on hard problems, see your work ship to production quickly, and influence how AI safety is actually built – you’re the one we need.

About the team

White Circle's fundamental research team works on the science of how AI systems fail in the real world: where agents break, how misalignment actually looks like to the end user, and how it is present in the model internals. We build the evals, benchmarks, environments, and tooling that empirically study high-impact agent reliability concerns — some of which become the guardrails shipped in our products, and some of which become public writeups.

You will:

Own and maintain our internal benchmark suite, covering single/multi-turn content guardrails and agentic safety.
Build benchmarks that distinguish specific model capabilities.
Work with the product team to build evals covering core functionality of our flagship models.
Build benchmarks for new features coming out of the research team.
Adapt and extend evals to new verticals and changing product data.
Work on research projects that study and quantify realistic agentic and LLM failure modes in the wild.

You’ll fit right in if you:

Have built an LLM benchmark from scratch that distinguished specific model capabilities (i.e., produced a measurable, defensible capability difference, not just a score).
Have built synthetic data for post-training textual or multimodal models.
Can reproduce a published benchmark result and identify where the original methodology is fragile or misleading.
You write Python that other people can build on. Our whole stack is Python; we want someone who has shipped and maintained production code and who factors messy problems into clean abstractions others can extend.
You can write efficient LLM inference setups, including sensible orchestration of parallel calls, retries, rate-limit handling.
An AI power-user — fluent with frontier models and coding agents day to day.

A big plus:

Automated red-teaming experience
Have worked across a range of agentic scaffolds and reproduced public benchmark results on them
Strong knowledge of existing reward-model / monitoring / safety benchmarks
One or more published papers in the evals / safety-evaluation space

Why White Circle

Paid time off in line with your local regulations, no matter where you work from.
Work from Paris (hybrid) with a relocation package available, or work from London (note: we are unable to provide relocation support or private medical insurance for London-based roles for now).
Meaningful equity package
Comprehensive medical insurance for our France-based team
All the hardware, tools, and services you need
Covered subscriptions for AI agents and IDEs
Team off-sites twice a year: we’ve recently been to the Alps and to Saint-Tropez

How we hire

Introductory call with HR (25 min)
Take-home test task
Technical interview with Head of Fundamental Research (60 min)
Final conversation with our CEO (45 min)

Please submit your application in English.

Find Jobs in France on Arbeitnow

Skills

Research

Similar roles

Product Manager - Device Data Management (Fluent French & English)
Kaluza·Paris, France
Job title: Product Manager - Device Data Management (Fluent French & English)  Location: Paris — Hybrid (3 days in office) Salary: €57,600 - €72,000 Team: Product Management - Data Device Management  Reporting to: Group Product Manager This role is based in Paris, France and requires the successful candidate to be based in or willing to relocate to Paris. Fluent French and English (spoken and…
- On-site
- Full-time
2h ago
Senior Software Engineer I
Kaluza·Paris, France
Job Title: Senior Engineer I Location: Paris (Hybrid) Salary: €54,000 - €70,000 Team: Client Engineering  Reporting To: Software Engineering Manager This role is based in Paris and requires an existing right to work in France. At this time, we are not able to offer visa sponsorship for this role. We are committed to building a diverse, global team and our…
- On-site
- Full-time
2h ago
Product Manager - Energy Billing (Fluent French & English)
Kaluza·Paris, France
Job title: Product Manager (Billing) Location: Paris — Hybrid (3 days in office) Salary: €57,600 - €72,000 Team: Product Management - Billing & Payments Reporting to: Head of Product This role is based in Paris, France and requires the successful candidate to be based in or willing to relocate to Paris. Fluent French and English (spoken and written) are essential for this position.  At…
- On-site
- Full-time
2h ago
Product Manager (Data) - Fluent French & English
Kaluza·Paris, France
Job Title: Product Manager (Data) Location: London, Bristol or Paris (Hybrid - 3 days in office) Team: Data Products Reporting To: Director of Product This role is based in London, Bristol or Paris and requires existing right to work in the UK or France. At this time, we are not able to offer visa sponsorship for this role. We are committed to building…
- On-site
- Full-time
2h ago
Product Manager (CCaaS) - French Speaking
Kaluza·Paris, France
Job title: Product Manager  Location: Paris — Hybrid - 3 days in office Salary: €45,600 - €57,000 Team: Product Management - Customer Care Value Stream Reporting to: Head of Product  This role is based in France and requires the successful candidate to be based in or willing to relocate to France. Fluent French and English (spoken and written) are essential for this position.  At…
- On-site
- Full-time
2h ago
Enterprise Account Executive - France
Verkada·Paris, France
<div class="content-intro"><h3>Who We Are</h3> Verkada is transforming how organizations protect their people and places with an integrated, privacy-sensitive AI-powered platform that includes solutions for video security, access control, air quality sensors, alarms, intercoms, and visitor management.  We’ve got serious momentum in the market: more than 30,000 customers (including 100+ of the Fortune 500), <a href="https://www.cnbc.com/2025/12/03/verkada-capitalg-valuation-security.html">a $5.8B valuation</a>, more than $1…
- On-site
- Full-time
2h ago
Director, Enterprise Sales
Yext·Paris, France
<div class="content-intro">Yext (NYSE: YEXT) is the enterprise agentic marketing platform. Built on the world's most comprehensive structured data platform for local businesses, Yext gives brands and their partners the visibility intelligence to win every moment of discovery – across AI and traditional search. Yext's API-first architecture connects structured data to APIs, MCP servers, and generative interfaces, so partners and developers…
- On-site
- Full-time
2h ago
Account Executive - Mid-Market - France
Primer.io·France
An Introduction to Primer Primer is the unified infrastructure for global payments. We give finance and payments teams the visibility and control to reduce complexity, improve performance, and capture more revenue - all from a single platform. Backed by Sofina, Peak XV Partners, ICONIQ, Tencent, Accel, and Balderton, we're building the payments layer the world's best companies rely on. Watch…
- On-site
- Full-time
2h ago