Machine Learning Platform Engineer
About A1
There are over 5 billion users using basic applications today such email, notes, tasks that are not AI-native. Our mission is to build a proactive smart assistant for everyday users to bring intelligence to conversations, errands, organising and workflows, with minimal prompting.
Our product focuses on achieving high reliability for long-running workflows, persistent context, and real-world task completion. The system must handle multi-step reasoning, interact with external tools, and remain reliable despite non-deterministic model behavior. Our objective is to help users complete tasks daily enjoyable with over ~90%* reduced time.
About the Role
As an ML Platform Engineer, you will build the infrastructure and systems that power A1's AI capabilities.
You will design and operate the systems behind the AI stack, from model training and evaluation to deployment, inference, observability, and continuous improvement.
You will work closely with AI engineers, researchers, and product engineers to turn models into reliable, scalable, and cost-efficient production systems. You will build the platforms, tooling, and infrastructure that enable the team to experiment quickly and bring AI capabilities to production with confidence.
Focus
Build and operate the ML infrastructure and platforms powering A1’s AI products
Design systems for model training, evaluation, deployment, inference, and experimentation
Build and optimise model serving and inference infrastructure for high-throughput and low-latency workloads
Improve reliability, scalability, latency, and cost efficiency of AI systems
Develop reliable pipelines for data preparation, training, evaluation, model release, and continuous improvement
Build platforms and tooling that enable AI engineers and researchers to experiment, evaluate, and ship models faster
Develop evaluation and benchmarking infrastructure to measure model quality, performance, and regressions
Build production observability, monitoring, tracing, and alerting for AI/ML workloads
Improve AI systems across reliability, scalability, latency, throughput, and cost
Identify bottlenecks across the ML stack and continuously improve system performance
Work closely with AI engineers, researchers, and product teams to turn evolving model requirements into production-ready infrastructure
Tech Stack
Python
PyTorch / JAX
LLM and ML serving infrastructure such as vLLM, SGLang, or TensorRT-LLM
Cloud infrastructure
Distributed systems
ML/data pipelines and workflow orchestration
GPU infrastructure and performance tooling
Vector databases and retrieval infrastructure
Ideal Experience
Strong software engineering fundamentals and experience building production systems
Experience building ML infrastructure, platforms, or production machine learning systems
Experience with model deployment, inference, evaluation, or data pipelines
Strong understanding of distributed systems and system reliability
Ability to write clean, maintainable, production-quality code
Comfortable working in ambiguous, fast-moving environments
Bias toward ownership, experimentation, and continuous improvement
Outcomes
AI infrastructure reliably supports production workloads at scale
Models can be trained, evaluated, deployed, and improved efficiently
Inference systems deliver strong latency, throughput, reliability, and cost efficiency
ML pipelines are reproducible, observable, maintainable, and robust
Model and infrastructure regressions are detected quickly and diagnosed efficiently
Common ML infrastructure capabilities become reusable platform primitives rather than being rebuilt for every AI product
The AI stack can evolve rapidly as new models, architectures, and inference techniques emerge
Find more English Speaking Jobs in Germany on Arbeitnow
Skills
- A1 Engineering
Similar roles
Analytics - Future Leaders Graduate Program
Teampicnic·Düsseldorf, Germany
<h2><strong>Real ownership. Real impact. Build from day one.</strong></h2> <p>Are you an ambitious graduate ready to tackle complex<strong>,</strong> real-world challenges at the intersection of data, strategy and tech? </p> <p><strong>The Future Leaders Graduate Program – Business Analytics</strong> at Picnic is a one-year launchpad for exceptional talents. From day one, you join a business team, own a business topic, and become an expert…
- On-site
- Full-time
- Blue Card — tied; settle 21–33mo
LLM Application Engineer
Bjak·Germany
About A1 There are over 5 billion users using basic applications today such email, notes, tasks that are not AI-native. Our mission is to build a proactive smart assistant for everyday users to bring intelligence to conversations, errands, organising and workflows, with minimal prompting. Our product focuses on achieving high reliability for long-running workflows, persistent context, and real-world task completion.…
- On-site
- Full-time
- Blue Card — tied; settle 21–33mo
Pflegepädagog:in als Educational Engagement Representative bei Novaheal
AMBOSS·Germany
Hallo, wir sind AMBOSS und wir suchen eine:n Educational Engagement Representative für Novaheal, um unsere Lern-App in Pflegeschulen und Bildungseinrichtungen in den gesamten deutschsprachigen Raum zu bringen. WARUM AMBOSS? AMBOSS ist der Copilot für den medizinischen Alltag. Mit unserer Plattform unterstützen wir Fachkräfte bei der Fortbildung sowie bei klinischen Entscheidungen, um stets die bestmögliche Patientenversorgung zu gewährleisten. Unser Team vereint…
- On-site
- Full-time
- Blue Card — tied; settle 21–33mo
Junior Sales Manager DACH (Remote in Germany)
AMBOSS·Germany
Hi, we're AMBOSS and we're looking for a Junior Sales Manager to help bring Novaheal to nursing schools across Germany. ABOUT AMBOSS AMBOSS is the copilot for medical professionals, empowering them to provide the best possible care through our learning and clinical decision support tool. Our team brings together care, innovative thinking, and cutting-edge AI medical technology. Our founders launched…
- On-site
- Full-time
- Blue Card — tied; settle 21–33mo
Senior Dokumentenmanager
TIS GmbH·Germany
Wir stellen ein: Senior Dokumentenmanager (m/w/d) Offshore-Windenergie | Onshore & Offshore Projekte | Festanstellung Die T.I.S. GmbH ist seit über 20 Jahren ein spezialisiertes Beratungs- und Serviceunternehmen im Bereich Offshore-Windenergie. Wir unterstützen internationale Kunden bei der Planung, Umsetzung und Qualitätssicherung komplexer Energieprojekte und arbeiten dabei mit führenden Unternehmen der Branche zusammen. Zur Verstärkung unseres Teams suchen wir einen Senior Dokumentenmanager…
- On-site
- Full-time
- Blue Card — tied; settle 21–33mo
(Junior) Finance Data Analyst (all genders)
Homaris·Berlin, Germany
Die Rolle Als (Junior) Finance Data Analyst (all genders) bei Homaris machst du aus Daten echte Entscheidungsgrundlagen: Du analysierst die wirtschaftliche Entwicklung unserer Geschäftsbereiche, baust und pflegst Power-BI-Dashboards und entwickelst unsere Unit-Economics-Sicht auf Objektebene weiter. Du arbeitest direkt mit dem CFO zusammen und erhältst echten Gestaltungsspielraum – mit einem klaren Entwicklungspfad in Richtung eigenständiger Controlling-Verantwortung. Wir schätzen Vielfalt und laden…
- On-site
- Full-time
- Blue Card — tied; settle 21–33mo
Senior Applied Value Engineer
Celonis·Munich, Germany
<div class="content-intro"><p>Celonis is the global leader in Process Intelligence and the pioneer of Process Mining technology. As one of the world’s fastest-growing enterprise SaaS companies, we are changemakers pushing the boundaries of what’s possible. We invest heavily in advanced AI capabilities—specifically our Process Intelligence Graph—to turn data insights into immediate business action. We believe there is a massive opportunity to…
- On-site
- Full-time
- Blue Card — tied; settle 21–33mo
(Senior) Marketing Analyst (m/f/d) - Berlin
freenow·Berlin, Germany
<p style="text-align: left;"><strong><em>Location</em></strong><em>: Come and join us in Hamburg, Berlin or Barcelona!</em></p> <p>As a (Senior) Marketing Analyst<strong> </strong>at Freenow you will become a key expert on customer data and retention mechanics. Working within the marketing data team, you will be responsible for developing, analyzing, and optimizing Freenow’s CRM and lifecycle marketing activities across Europe. </p> <hr> <h2><strong>YOUR DAILY ADVENTURES WILL INCLUDE:</strong></h2>…
- On-site
- Full-time
- Blue Card — tied; settle 21–33mo
