Bjak brand banner

LLM Application Engineer

BjakGermanyPosted 2h agoonsite
via Arbeitnow

About A1

There are over 5 billion users using basic applications today such email, notes, tasks that are not AI-native. Our mission is to build a proactive smart assistant for everyday users to bring intelligence to conversations, errands, organising and workflows, with minimal prompting.

Our product focuses on achieving high reliability for long-running workflows, persistent context, and real-world task completion. The system must handle multi-step reasoning, interact with external tools, and remain reliable despite non-deterministic model behavior. Our objective is to help users complete tasks daily enjoyable with over ~90%* reduced time.

About the Role

As an LLM Application Engineer, you will build the intelligence layer that powers A1's AI experiences.

You will work at the intersection of LLMs, software engineering, and product - designing agent workflows, improving model behaviour, and turning AI capabilities into reliable user experiences.

You will own problems end-to-end, from understanding user needs, designing Agentic workflows, integrating models and tools, building evaluation system and continuously improving AI behaviour in production.

Focus

  • Build and ship LLM-powered applications and AI agent workflows

  • Design systems for reasoning, planning, memory, tool uuse and multi-step execution

  • Build reliable orchestration pipelines that turn probabilistic model outputs into predictable, observable, and safe actions

  • Integrate LLMs with APIs, databases, search, internal services, and external tools.

  • Develop prompting, context engineering, structured outputs, tool-calling, and other techniques to improve model behaviour

  • Build evaluation frameworks and datasets to measure AI quality, reliability, and regressions

  • Debug AI systems across the entire stack—from model behaviour and prompts to orchestration, backend services, and product UX

  • Optimise AI systems for quality, latency, and cost

  • Work closely with product and engineering teams to turn ambiguous product problems into working AI solutions

  • Establish production practices for observability, tracing, experimentation, evaluation, and continuous improvement

Tech Stack

  • Python

  • LLM APIs and model providers, including OpenAI-compatible APIs and open-weight models

  • Agent frameworks and orchestration systems

  • Vector databases and retrieval systems

  • Backend services, APIs, and distributed systems

  • PyTorch / JAX

Ideal Experience

  • Strong software engineering fundamentals with experience building AI-powered applications

  • Hands-on experience with LLMs, generative AI, or agent-based systems

  • Experience designing prompts, workflows, evaluations, or AI behaviour

  • Ability to write clean, production-quality code

  • Comfortable working across abstraction layers (model → system → product)

  • Strong problem-solving skills in ambiguous, fast-moving environments

  • Bias toward shipping, iteration, and continuous improvement

Outcomes

  • AI features reach production quickly and deliver measurable user impact

  • LLM-powered workflows are reliable, scalable, observable, and maintainable

  • AI quality improves through systematic evaluation, experimentation, and iteration

  • AI workflows become increasingly predictable, efficient, and cost-effective

  • Complex AI capabilities are translated into simple, intuitive user experiences

Find Jobs in Germany on Arbeitnow

Skills

  • A1 Engineering

Similar roles

  • New Zealand Government logo

    Senior Engineer, Digitial

    New Zealand Government·Wellington, New Zealand

    The Civil Aviation Authority and the Aviation Security Service offer distinctively different career opportunities and embrace diverse talent. All jobs at the Authority contribute to ensuring safe and secure skies to help New Zealand fly. The Civil Aviation Authority is the regulatory arm of our organisation and the Aviation Security Service is the nationwide provider for aviation security. * Lead…

    • Full-time
    • NZD 136k–NZD 168k / yr
    • Skilled Migrant (Residence)PR, points-based, no single employer
  • Teampicnic logo

    Analytics - Future Leaders Graduate Program

    Teampicnic·Düsseldorf, Germany

    <h2><strong>Real ownership. Real impact. Build from day one.</strong></h2> <p>Are you an ambitious graduate ready to tackle complex<strong>,</strong> real-world challenges at the intersection of data, strategy and tech?&nbsp;</p> <p><strong>The Future Leaders Graduate Program – Business Analytics</strong> at Picnic is a one-year launchpad for exceptional talents. From day one, you join a business team, own a business topic, and become an expert…

    • On-site
    • Full-time
    • Blue Cardtied; settle 21–33mo
  • Bjak logo

    Machine Learning Platform Engineer

    Bjak·Germany

    About A1 There are over 5 billion users using basic applications today such email, notes, tasks that are not AI-native. Our mission is to build a proactive smart assistant for everyday users to bring intelligence to conversations, errands, organising and workflows, with minimal prompting. Our product focuses on achieving high reliability for long-running workflows, persistent context, and real-world task completion.…

    • On-site
    • Full-time
    • Blue Cardtied; settle 21–33mo
  • AMBOSS logo

    Pflegepädagog:in als Educational Engagement Representative bei Novaheal

    AMBOSS·Germany

    Hallo, wir sind AMBOSS und wir suchen eine:n Educational Engagement Representative für Novaheal, um unsere Lern-App in Pflegeschulen und Bildungseinrichtungen in den gesamten deutschsprachigen Raum zu bringen. WARUM AMBOSS? AMBOSS ist der Copilot für den medizinischen Alltag. Mit unserer Plattform unterstützen wir Fachkräfte bei der Fortbildung sowie bei klinischen Entscheidungen, um stets die bestmögliche Patientenversorgung zu gewährleisten. Unser Team vereint…

    • On-site
    • Full-time
    • Blue Cardtied; settle 21–33mo
  • AMBOSS logo

    Junior Sales Manager DACH (Remote in Germany)

    AMBOSS·Germany

    Hi, we're AMBOSS and we're looking for a Junior Sales Manager to help bring Novaheal to nursing schools across Germany. ABOUT AMBOSS AMBOSS is the copilot for medical professionals, empowering them to provide the best possible care through our learning and clinical decision support tool. Our team brings together care, innovative thinking, and cutting-edge AI medical technology. Our founders launched…

    • On-site
    • Full-time
    • Blue Cardtied; settle 21–33mo
  • TIS GmbH logo

    Senior Dokumentenmanager

    TIS GmbH·Germany

    Wir stellen ein: Senior Dokumentenmanager (m/w/d) Offshore-Windenergie | Onshore & Offshore Projekte | Festanstellung Die T.I.S. GmbH ist seit über 20 Jahren ein spezialisiertes Beratungs- und Serviceunternehmen im Bereich Offshore-Windenergie. Wir unterstützen internationale Kunden bei der Planung, Umsetzung und Qualitätssicherung komplexer Energieprojekte und arbeiten dabei mit führenden Unternehmen der Branche zusammen. Zur Verstärkung unseres Teams suchen wir einen Senior Dokumentenmanager…

    • On-site
    • Full-time
    • Blue Cardtied; settle 21–33mo
  • Homaris logo

    (Junior) Finance Data Analyst (all genders)

    Homaris·Berlin, Germany

    Die Rolle Als (Junior) Finance Data Analyst (all genders) bei Homaris machst du aus Daten echte Entscheidungsgrundlagen: Du analysierst die wirtschaftliche Entwicklung unserer Geschäftsbereiche, baust und pflegst Power-BI-Dashboards und entwickelst unsere Unit-Economics-Sicht auf Objektebene weiter. Du arbeitest direkt mit dem CFO zusammen und erhältst echten Gestaltungsspielraum – mit einem klaren Entwicklungspfad in Richtung eigenständiger Controlling-Verantwortung. Wir schätzen Vielfalt und laden…

    • On-site
    • Full-time
    • Blue Cardtied; settle 21–33mo
  • Celonis logo

    Senior Applied Value Engineer

    Celonis·Munich, Germany

    <div class="content-intro"><p>Celonis is the global leader in Process Intelligence and the pioneer of Process Mining technology. As one of the world’s fastest-growing enterprise SaaS companies, we are changemakers pushing the boundaries of what’s possible. We invest heavily in advanced AI capabilities—specifically our Process Intelligence Graph—to turn data insights into immediate business action. We believe there is a massive opportunity to…

    • On-site
    • Full-time
    • Blue Cardtied; settle 21–33mo