Backend Engineer, AI (Agent Systems)
About A1
There are over 5 billion users using basic applications today such email, notes, tasks that are not AI-native. Our mission is to build a proactive smart assistant for everyday users to bring intelligence to conversations, errands, organising and workflows, with minimal prompting.
Our product focuses on achieving high reliability for long-running workflows, persistent context, and real-world task completion. The system must handle multi-step reasoning, interact with external tools, and remain reliable despite non-deterministic model behavior. Our objective is to help users complete tasks daily enjoyable with over ~90%* reduced time.
Role
As a Backend Engineer, AI, you own the inference and orchestration layer that powers every AI interaction in the product. Your work sits between models and users, where latency, correctness, reliability, and cost directly impact real-world experience.
You will build and operate production systems that turn model capability into fast, stable, observable APIs used across mobile and desktop clients.
Focus
Build and operate backend systems that serve AI-powered features in production.
Design inference pipelines, orchestration layers, and service boundaries around models.
Own production concerns: monitoring, logging, alerting, and incident response.
Optimize latency and throughput across inference, caching, batching, and streaming.
Ideal Experiences
Strong backend engineering fundamentals in production environments.
Experience running high-throughput, low-latency services.
Familiarity with AI inference patterns (LLMs, embeddings, multimodal).
Comfortable debugging distributed systems under load.
Bias toward shipping and learning from production behavior.
Outcomes
Backend systems run reliably at scale, handling production AI traffic with low latency and high throughput.
APIs are stable, clear, and support seamless integration with frontend and ML systems.
Production incidents are quickly detected, diagnosed, and resolved, minimizing user impact.
Iterative improvements based on real usage continuously increase system performance and reliability.
Tech Stack
Python
NodeJs
Pytorch
OpenAI / Anthropic / open-source LLMs
SQl & noSQL
Kubernetes
Docker
How We Work
The best products today in the world were built by small, world class teams. We are a high talent density and hands-on team. We make decisions collectively, move at rapid speed, striking a balance between shipping high quality work and learning. Joining our team requires the ability to bring structure, exercise judgment, and execute independently. Our goal is to put in hands of our users a truly magical product
Interview process
If there appears to be a fit, we'll reach to schedule 3, but no more than 4 interviews.
Applications are evaluated by our technical team members. Interviews will be conducted via virtual meetings and/or onsite.
We value transparency and efficiency, so expect a prompt decision. If you've demonstrated the exceptional skills and mindset we're looking for, we'll extend an offer to join us. This isn't just a job offer; it's an invitation to be part of a team that's bringing AI to have practical benefits to billions globally.
Find Jobs in Germany on Arbeitnow
Skills
- A1 Engineering
Similar roles
Frontend Software Engineer
Corto Pty Ltd·Sydney, Australia
About CORTO We are CORTO, a cutting-edge software company dedicated to revolutionising the legal industry. Our mission is to empower legal practitioners with AI-driven solutions that streamline their workflow, boost productivity, and provide more efficient client service. Our team of AI experts and engineers collaborate to develop intelligent software tailored to the unique needs of lawyers, paralegals, and legal assistants.…
- Hybrid
- Full-time
- Skilled Independent 189 — PR, no sponsor
Forward Deployed Engineer - AI
Avepoint·Munich, Germany
<p> </p> <p class="PDq2pG_selectionAnchorContainer" data-start="184" data-end="439">Enterprises are adopting AI faster than they can govern it — and they are looking for a partner who can do two things at once: speak credibly about AI trust, governance, and security, and actually build. The Forward Deployed Engineer (AI) is that partner.</p> <p class="PDq2pG_selectionAnchorContainer" data-start="184" data-end="439"> </p> <p data-start="441" data-end="780">You are the technical face of…
- On-site
- Full-time
- Blue Card — tied; settle 21–33mo
Buchhalter (m/w/d)
PraxisEins·Frankfurt am Main, Germany
Buchhalter (m/w/d) Um unser Wachstum weiter erfolgreich voranzutreiben, suchen wir Dich als engagierte Unterstützung im Bereich Buchhaltung in Teil- oder Vollzeit (ab 25 Stunden pro Woche). In dieser Rolle bist Du die organisatorische und koordinierende Schaltstelle unseres Finance-Teams – und sorgst dafür, dass unsere Abläufe und unsere Buchhaltung zuverlässig und reibungslos funktionieren. Standort: Frankfurt am Main | Home Office: bis…
- On-site
- Full-time
- Blue Card — tied; settle 21–33mo
Head of Finance/ Leitung Finanzen (m/f/d)
PraxisEins·Frankfurt am Main, Germany
Es ist Zeit für die Praxis der Zukunft, werde Teil von PraxisEins! PraxisEins ist ein Healthcare Scale-up aus Frankfurt: Wir bauen Deutschlands führenden Primärversorger auf. Hierfür übernehmen wir Hausarztpraxen, digitalisieren diese mit eigener Software und kümmern uns aktiv um eine stetige Verbesserung der Patientenversorgung. So sichern wir langfristig die hausärztliche Versorgung in Deutschland, insbesondere in schlecht versorgten Gebieten. Unsere erfahrenen…
- On-site
- Internship
- Blue Card — tied; settle 21–33mo
M&A Intern (m/w/d)
PraxisEins·Frankfurt am Main, Germany
Unsere erfahrenen Kollegen kommen von führenden Unternehmen wie BCG, McKinsey, Goldman Sachs und Oaktree Capital und haben bereits erfolgreich HealthTech-Rollups auf- und ausgebaut. Wenn du eine Karriere im M&A, Private Equity oder Investmentbanking anstrebst und hands-on Erfahrung in einem dynamischen Umfeld sammeln willst, bist du bei uns richtig! Deine Aufgaben * M&A-Prozesse: Unterstützung in der Strategie und Umsetzung von Praxisakquisitionen,…
- On-site
- Internship
- Blue Card — tied; settle 21–33mo
Staff Customer Success Manager
Kong·Germany
Are you ready to unlock intelligence? If you don’t think you meet all of the criteria below but are still interested in the job, please apply. Nobody checks every box - we’re looking for candidates that are particularly strong in a few areas, and have some interest and capabilities in others. About the Role: As a Staff/Senior Customer Success Manager,…
- On-site
- Full-time
- Blue Card — tied; settle 21–33mo
Werkstudent Trier (m/w/d)
My Jewellery·Trier, Germany
Als Werkstudent/-in in unserer Boutique in Trier bist du das Gesicht von My Jewellery. Du begrüßt Kund/-innen mit viel Begeisterung, gibst individuelle Styling-Tipps und sorgst dafür, dass jede Person die Boutique mit einem Lächeln verlässt. Gemeinsam mit deinem Team schaffst du eine inspirierende und einladende Atmosphäre im Store. Du sorgst dafür, dass die Boutique immer gepflegt aussieht und präsentierst die…
- On-site
- Full-time
- Blue Card — tied; settle 21–33mo
Werkstudent (m/w/d) im Verkauf Mode und Bekleidung
KULT | OLYMP & HADES·Schwerin, Germany
Fashion ist deine Passion? Du sprühst vor Kreativität und arbeitest gerne mit Menschen? Dann suchen WIR genau DICH für unsere Filiale! In unseren Filialen OLYMP & HADES sowie KULT erlebst Du die Vielfalt angesagter Styles und arbeitest mit aufstrebenden Newcomern und Labels zusammen. Wir begrüßen ausdrücklich Bewerbungen von Menschen mit Behinderung und berücksichtigen diese bei gleicher Qualifikation bevorzugt. Das erwartet…
- On-site
- Full-time
- Blue Card — tied; settle 21–33mo
