Toptal brand banner

Python Backend Development Talent with RAG and Agentic AI Experience

ToptalWorldwidePosted just nowremote
via Findwork

Summary:

We are seeking an experienced Python Backend Developer to design, build, and deploy scalable AI-powered applications using Retrieval-Augmented Generation, large language models, and agentic AI frameworks. The role will focus on delivering a production-grade RAG system and AI chatbot that can securely integrate with enterprise data, APIs, databases, and cloud services.

General information:

The organization is developing an AI-powered platform and requires an experienced individual contributor to build its RAG architecture and conversational AI capabilities. The developer will work closely with a distributed team and should be available for several hours of overlap with US working hours.

The project involves designing AI systems that go beyond basic prompt engineering, including multi-step workflows, autonomous agents, vector search, knowledge retrieval, memory management, and tool integration. The solution must be scalable, secure, observable, and suitable for production use.

The technology environment includes Python, FastAPI, large language models, LangGraph, LangChain, vector databases, Azure AI services, AWS, Docker, Kubernetes, and microservice-based architectures.

Task and deliverables:

  • Design the end-to-end architecture for a scalable RAG system and AI chatbot.
  • Develop Python backend services, REST APIs, and microservices using FastAPI or similar frameworks.
  • Build document ingestion, chunking, embedding, indexing, retrieval, and reranking pipelines.
  • Implement vector search solutions using Azure AI Search or comparable vector databases.
  • Design autonomous AI agents capable of planning, reasoning, tool usage, and decision-making.
  • Develop multi-step AI workflows using LangGraph, LangChain, CrewAI, AutoGen, or similar orchestration frameworks.
  • Integrate commercial and open-source LLMs, including Azure OpenAI, OpenAI, Anthropic Claude, Gemini, and comparable models.
  • Implement conversation memory, session management, context management, and agent collaboration patterns.
  • Connect AI workflows with APIs, databases, enterprise systems, and external tools.
  • Develop asynchronous, high-performance services capable of handling concurrent AI workloads.
  • Implement prompt management, structured outputs, guardrails, fallback logic, and model evaluation processes.
  • Establish logging, monitoring, tracing, observability, security, and error-handling standards.
  • Containerize and deploy AI services using Docker, Kubernetes, Azure, or AWS.
  • Translate business requirements into technical designs, delivery milestones, and production-ready AI solutions.
  • Collaborate with the wider team while independently owning architecture and implementation decisions.

Required experience:

  • Required: 8 or more years of professional Python backend development experience.
  • Required: Strong experience designing REST APIs, microservices, asynchronous services, and distributed backend systems.
  • Required: Hands-on experience building production-grade RAG applications.
  • Required: Strong understanding of embeddings, document chunking, semantic search, vector indexing, retrieval strategies, and reranking.
  • Required: Hands-on experience developing AI agents and multi-step LLM workflows.
  • Required: Experience with agentic AI frameworks such as LangGraph, LangChain, CrewAI, AutoGen, or comparable platforms.
  • Required: Experience integrating LLMs through OpenAI, Azure OpenAI, Anthropic Claude, Gemini, or open-source model APIs.
  • Required: Ability to design AI architecture beyond basic prompt engineering.
  • Required: Experience integrating AI applications with APIs, databases, data pipelines, and enterprise systems.
  • Required: Experience implementing security, monitoring, logging, tracing, and observability for production services.
  • Required: Experience deploying containerized applications using Docker and cloud platforms such as Azure or AWS.
  • Required: Ability to independently translate business requirements into scalable technical solutions.
  • Required: Strong communication and collaboration skills in a distributed working environment.
  • Required: Availability for several hours of overlap with US working hours.


Skills

  • crewai
  • gemini
  • claude
  • langgraph
  • ai
  • autogen
  • langchain
  • python
  • azure
  • docker
  • agents
  • openai
  • chatbot
  • llm
  • rag
  • aws
  • kubernetes
  • anthropic
  • fastapi

Similar roles

  • Toptal logo

    [Expert Crowd] Personal Finance consultants for AI model

    Toptal·Worldwide

    We are looking for experienced personal finance professionals to support the training and evaluation of AI models. You should have hands-on experience advising individual clients or households on real-world financial decisions. Areas of Expertise * We are seeking talent with experience in one or more of the following: * Personal Tax: Individual tax returns (1040), tax planning, capital gains, self-employment…

    • Remote
    • Full-time
  • Discord logo

    Senior Software Engineer, Data Platform

    Discord·Worldwide

    Discord has a highly engaged community of millions of daily active users who use the platform for many different reasons, but there’s one thing that nearly everyone does: play video games. Discord plays a uniquely important role in the future of gaming, and we are focused on making it easier and more fun for people to hang out before, during,…

    • Full-time
  • BMW Group logo

    Azubi zum Werkzeugmechaniker (w/m/x) - Werk [2 Plätze]

    BMW Group·Landshut, Germany

    Aufgaben Du möchtest technische Ideen Wirklichkeit werden lassen? Dann ist diese Ausbildung genau das Richtige für dich. Denn du besitzt das Know-how, um hochmoderne Fertigungsanlagen, Vorrichtungen sowie Stanz- und Umformwerkzeuge für die industrielle Serienfertigung zu fertigen, zu montieren und auch zu reparieren, um so Freude am Fahren auf die Straße zu bringen. Was lernst du bei uns? Lesen und Interpretieren…

    • Full-time
    • Blue Cardtied; settle 21–33mo
  • Städtisches Klinikum Karlsruhe gGmbH logo

    Anlagenmechaniker/in Heizung-Sanitär (m/w/d)

    Städtisches Klinikum Karlsruhe gGmbH·Karlsruhe, Germany

    Das Städtische Klinikum Karlsruhe ist das größte Krankenhaus in der Region Mittlerer Oberrhein. Es ist im Krankenhausbedarfsplan des Landes Baden-Württemberg als Haus der Maximalversorgung für die Region ausgewiesen und Lehrkrankenhaus der Universität Freiburg. Tag für Tag und rund um die Uhr stellen über 4.900 qualifizierte Mitarbeiter/innen die Versorgung der Patient/innen sicher. Für den Geschäftsbereich Infrastruktur, Abteilung Technisches Management, suchen wir…

    • Full-time
    • Blue Cardtied; settle 21–33mo
  • Ki logo

    Temporary Actuarial Analyst

    Ki·London, United Kingdom

    Who are we?👋 Look at the latest headlines and you will see something Ki insures. Think space shuttles, world tours, wind farms, and even footballers’ legs. Ki’s mission is simple. Digitally disrupt and revolutionise a 335-year-old market. Working with Google and UCL, Ki has created a platform that uses algorithms, machine learning and large language models to give insurance brokers…

    • Temp
  • ValJob logo

    Industrial Maintenance Manager

    ValJob·Sitten, Switzerland

    INDUSTRIAL MAINTENANCE MANAGER 100% - PERMANENTAre you looking for a new challenge? ValJob, active since in recruitment and Human Resources services, is a leading Swiss company, recognized and appreciated for the quality of its services and the high performance of its We are looking for the following profile for one of our clients:INDUSTRIAL MAINTENANCE MANAGER 100% - PERMANENTYour mission:For our…

    • Full-time
  • Le Grand & Associates logo

    Junior Controller met wagen

    Le Grand & Associates·Antwerpen, Belgium

    Junior Controller / Finance Consultant | 32 verlofdagen | Bedrijfswagen geen overuren Ben je de lange uren in audit beu, maar wil je je analytische bagage niet zomaar opzij schuiven? Mis je in je huidige rol de variatie en de rechtstreekse impact op de business? En vraag je je af of er een functie bestaat waarin je élke dag met…

    • Full-time
  • Aviso Wealth logo

    Gestionnaire du programme d’absences autorisées et de mesures d’adaptation

    Aviso Wealth·Vancouver, Canada

    Aviso : À Aviso, nous nous consacrons à l’amélioration du bien-être financier des Canadiennes et des Canadiens. À titre d’organisation de gestion de patrimoine de premier plan, nous nous engageons à faire preuve de leadership, d’innovation et de responsabilité ainsi qu’à miser sur le partenariat et la communauté. En travaillant avec des professionnels talentueux et énergiques qui incarnent nos valeurs…

    • Full-time
    • Express EntryPR day one, no employer