Blue Machines AI brand banner

Quality Engineering Lead

Blue Machines AIBengaluru, IndiaPosted 2h ago
via Workable

Quality Engineering Lead

Blue Machines · Full-time

About Blue Machines

Blue Machines builds the platform for production AI agents — agent builder, real-time voice agents, workflow orchestration, integrations, and inference. Multi-tenant systems, non-deterministic behaviour, many providers in the call path, and high bar for what ships to customers.

About the role

We are hiring a founding Quality Engineering Lead — a builder who designs and ships the systems that decide what is safe to release. Your output is platforms and mechanisms, not test cases. You may grow a team later; you are hired to build first.

What you will do

  • Design and build the test platform: execution, isolation, test-data lifecycle, reporting, flake handling, and a clear answer to whether a build should ship
  • Build an agent evaluation harness that detects behavioural regressions after prompt, model, tool, or config changes
  • Own release gating: enforceable gates in code, post-deploy verification, canary criteria, and a narrow hotfix path
  • Treat capacity and load as release criteria, not optional reports
  • Turn customer-visible defects into durable detection (owned, staged, measurable)
  • Push testability into product systems — seams, replay, fault injection, observability
  • Raise the engineering bar through review and mechanisms, not by writing every test yourself

What we are looking for

  • Strong software engineering background — you can design a system from an ambiguous problem and implement the hard path
  • Experience owning quality, reliability, release, or evaluation platforms (not only writing suites)
  • Experience with conversational AI, voice, or LLM evaluation — or a clear track record evaluating non-deterministic systems without ground truth
  • Release engineering, progressive delivery, or SRE depth — gates, canaries, and production signal you have owned
  • Hands-on building of CI/CD quality infrastructure at meaningful scale
  • Product mindset — you tie quality work to customer-visible risk and delivery outcomes
  • Evidence over assertion — you quantify, and you separate known from assumed
  • Ability to work with a small team and influence engineers who do not report to you

This role is not

A manual QA role, a checklist sign-off role, or a hire to write Playwright/pytest cases as the main job. We already have deep automation capability; we need the architect who builds what sits above it.

Similar roles

  • Druva logo

    Product Manager

    Druva·Pune, India

    About Druva Druva is the resilience foundation for the AI enterprise, helping organizations secure and recover from connected risk across data, cyber, identity, and AI. The Resilience Cloud is a fully managed, cloud-native SaaS platform that delivers air-gapped and immutable protection across cloud, SaaS, on-premises, endpoint, and edge environments. Powered by Dru MetaGraph, Druva’s graph-powered intelligence layer, the platform connects…

    • Full-time
  • GroundTruth logo

    Senior Billing Analyst

    GroundTruth·India

    GroundTruth is an advertising platform that turns real-world behaviour into marketing that drives in-store visits and other real business results. We use observed real-world consumer behavior, including location and purchase data, to create targeted advertising campaigns across all screens, measure how consumers respond, and uncover unique insights to help optimize ongoing and future marketing efforts. With this focus on media,…

    • Remote
    • Full-time
  • Datadog logo

    Technical Escalations Engineer 2 (Agent) - US-West

    Datadog·Denver, United States

    The Team As Datadog’s in-house product experts, the Technical Escalation Engineering (TEE) team plays a critical role in driving our global success. We enable our customers, from the world’s most innovative startups to the largest enterprises. Through deep technical expertise, relentless problem-solving, and exceptional customer engagement, we educate, guide, and troubleshoot, delivering high-impact solutions that shape the customer experience. Whether…

    • Full-time
  • BloomVet logo

    Associate Veterinarian

    BloomVet·Mumbai, India

    Company Description BloomVet is dedicated to delivering compassionate, high-quality veterinary care that supports the health and well-being of pets at every life stage. Under one roof, BloomVet offers comprehensive services including medical care, grooming and spa treatments, and a curated selection of pet products to create a seamless experience for pet parents. The team of veterinarians, technicians, and support staff…

    • Full-time
  • Euronet Worldwide, Inc. logo

    Assistant Manager - Accounts Payable

    Euronet Worldwide, Inc.·Mumbai, India

    Position: Assistant Manager - Accounts Payable Location: Thane Experience: 4 - 6 years Mandatory Skills: * 4–6 years of relevant finance/rent operations experience (Accounts Payable) * Experience in payment processing and reconciliations. (Bank and Ledger) * Exposure to TDS/GST and month-end activities. * Good working knowledge of MS Excel. * Good communication and stakeholder management skills. Roles & Responsibilities: *…

    • Full-time
  • BreachLock logo

    Sr. Finance Analyst / Manager - Finance

    BreachLock·Pune, India

    1.End-to-End R2R Process Ownership * Manage the complete R2R process, including journal entries, general ledger (GL), fixed assets, intercompany accounting, reconciliations, and financial reporting. * Ensure the timely and accurate execution of monthly, quarterly, and annual financial closings. * Align R2R processes with global standards, accounting principles (GAAP/IFRS), and internal controls. 2. Team Management & Leadership * Lead and manage…

    • Full-time
  • GSSTech Group logo

    Sr. SQL Server DBA Engineer

    GSSTech Group·Bengaluru, India

    We are looking for a highly experienced Senior SQL Server DBA Engineer with strong expertise in Microsoft SQL Server Administration, Database DevOps, High Availability (HA), Disaster Recovery (DR), and database automation. The ideal candidate will be responsible for designing, administering, optimizing, securing, and automating enterprise-scale SQL Server environments while ensuring high availability, reliability, performance, and operational excellence across mission-critical platforms.…

    • Full-time
  • Teltonika logo

    Logistics Coordinator

    Teltonika·Bengaluru, India

    We are looking for a Logistics Coordinator to join our India team. If you are a professional with demonstrated experience in logistics, including administration and warehousing and stock management (SO), motivated with an ability to multi-task, proactive communication, work well under pressure, and a demonstrated eye for detail, you definitely should join us! In this role, you will: * As…

    • Full-time