Junior AI/ML Engineer, Data and Evaluation
We are building a new capability that turns fragmented, noisy security logs into explainable, AI-powered threat analysis, delivered inside the RedMimicry platform.
As an AI/ML Engineer at RedMimicry, you will build the datasets, benchmarks, and evaluation infrastructure behind our applied AI/ML work on security telemetry.
The quality of this work depends on accurate ground truth, disciplined data handling, reproducible experiments, and systematic error analysis. Your work will determine whether reported improvements are real and whether regressions are caught before deployment.
You will work closely with the Senior AI/ML Engineer and Offensive Security Engineer. This role is suitable for an early-career or intermediate engineer with strong programming and data skills who wants to work on applied AI in a technically demanding cybersecurity environment.
This is a fixed-term position running until 31 October 2027.
Tasks
- Curate Security Datasets: Prepare telemetry from controlled engagements and test environments.
- Build Ground Truth: Create and maintain labelled examples, annotation guidelines, and consistency checks.
- Maintain Evaluation Partitions: Separate training, validation, and test data along relevant dimensions.
- Automate Benchmarks: Implement metrics and maintain reproducible benchmark and regression pipelines that run locally and in CI.
- Run Experiments and Error Analysis: Evaluate models and methods, and identify recurring failure modes and data-quality issues.
- Maintain Data Quality: Implement schema checks, provenance tracking, deduplication, validation, and dataset versioning.
- Document Experiments: Produce clear experiment records, plots, tables, and technical summaries that support engineering decisions.
Requirements
You do not need to meet every requirement to apply. Strong practical work, research projects, open-source contributions, or a relevant thesis can compensate for limited commercial experience.
-
Programming and Data Work
-
Good Python programming skills
-
Experience with Pandas, NumPy, PyTorch, or similar tooling
-
Ability to process structured and unstructured data reliably
-
Familiarity with Git, automated tests, and reproducible development workflows
-
Machine Learning and Evaluation
-
Working understanding of supervised evaluation, train/test separation, and basic statistics
-
Familiarity with language models, embeddings, retrieval, classification, or information extraction
-
Experience with experiment tracking, benchmarking, or regression testing
-
Ability to distinguish statistically meaningful results from anecdotal examples
-
Data Quality and Annotation
-
Careful handling of labels, provenance, edge cases, and ambiguous examples
-
Experience with dataset annotation or benchmark construction is a plus
-
Ability to write clear annotation and evaluation guidelines
-
Cybersecurity Knowledge
-
Security logs, operating-system telemetry, SIEM, EDR, network data, or incident-response experience is a plus
-
Interest in attacker behaviour, detection, and evidence-based security analysis
-
Education
-
Degree in computer science, data science, machine learning, mathematics, cybersecurity, or a related discipline, or equivalent practical experience
-
Languages
-
English (required)
-
German (a plus)
Benefits
- Work from anywhere in Germany, and use our Berlin office as often as you like
- 30 days of paid time off, and a quiet inbox while you are away
- Company-paid Deutschlandticket
- Annual budget for the courses and certifications you pick yourself
- Modern tooling and extensive use of AI
- Light process, clear communication, focus on what really matters
A close match is enough. If the role speaks to you, apply with your CV and anything else you would like us to see. What follows is short and transparent, a few conversations with the team and then your first week in Berlin. We are an equal opportunity employer and welcome applications from all backgrounds and genders. Questions about the role or the process are welcome at any point.
Find Jobs in Germany on Arbeitnow
Skills
- Data Processing
- Data Engineer
Similar roles
Softwareentwicklung - .NET (C# / VB.NET) mit Kundenprojekten
Valsoft Corp·Mülheim, Germany
Über INPLAN INPLAN entwickelt seit über 30 Jahren Standardsoftware für Häfen, Terminalbetreiber und Logistikdienstleister sowie für Einkaufs- und Beschaffungsprozesse (Source-to-Pay). Unsere Lösungen steuern geschäftskritische Abläufe an mehr als 50 Standorten in Deutschland und Europa. Als Teil der internationalen Valsoft Corporation verbinden wir die Stabilität eines Konzerns mit kurzen Entscheidungswegen. Die Rolle Sie entwickeln unsere Produkte weiter – und Sie sprechen…
- On-site
- Full-time
- Blue Card — tied; settle 21–33mo
Security & Compliance Engineer - Remote Germany
Linro·Germany
ABOUT LINRO Linro is a cloud security company building a real-time, agentic cloud-security platform. Teams ship with AI. AI ships with Linro. Cloud infrastructure changes constantly, and increasingly it's AI agents making those changes, not people. Most security tools only catch problems after the fact. Linro works differently. We enforce what's allowed at every stage, from commit to production. We…
- On-site
- Full-time
- Blue Card — tied; settle 21–33mo
Senior Sales Specialist - Voice - DACH
DeepL·Munich, Germany
MEET DEEPL DeepL is a global AI product and research company focused on building secure, intelligent solutions to complex business problems. Over 200,000 business customers and millions of individuals across 228 global markets today trust DeepL's Language AI platform for human-like translation, improved writing and real-time voice translation. Founded in 2017 by CEO Jaroslaw “Jarek” Kutylowski, DeepL now has around…
- On-site
- Full-time
- Blue Card — tied; settle 21–33mo
Teamleiter Finanzbuchhaltung (w/m/d) mit Input für die weitere Prozessoptimierung
Fischer & Partner Gesellschaft für Personal mbH·Stuttgart, Germany
Für ein gesundes und nachhaltig agierendes kleineres Unternehmen mit zahlreichen Tochtergesellschaften und top City-Lage in Stuttgart suchen wir Sie zum nächstmöglichen Zeitpunkt als Teamleiter Finanzbuchhaltung (w/m/d) mit Input für die weitere Prozessoptimierung. In Abhängigkeit von Ihren Kenntnissen und Ihrer Berufserfahrung können Sie hier bis zu 90.000 € p.a. verdienen. Die Vollzeitstelle bietet Ihnen Homeoffice-Anteil von einem Tag pro Woche nach…
- On-site
- Full-time
- Blue Card — tied; settle 21–33mo
Sachbearbeiter Exportkontrolle & Zoll (m/w/d)
AOP/FCI Deutschland GmbH·Berlin, Germany
Du sicherst die rechtlich konforme und effiziente Abwicklung des Exports von Transceivern und opto-elektronischen Bauteilen mit Dual-Use-Relevanz und garantierst die Einhaltung aller internationalen Exportkontrollvorschriften und minimierst Compliance-Risiken für das Unternehmen. AUFGABEN * Du sorgst dafür, dass unsere Produkte (z.B. Dual-Use-Güter) richtig klassifiziert sind nach EU- und US-Exportvorschriften (ECCN, Zolltarif) * Bei dir ist der gesamte BAFA-Genehmigungsprozess zielsicher in guten Händen…
- On-site
- Full-time
- Blue Card — tied; settle 21–33mo
Senior Enterprise Architect (w/m/d/x) Insurance
EMIL Group GmbH·Berlin, Germany
DEINE ROLLE Als Senior Enterprise Architect (w/m/d/x) verantwortest du die technische Gesamtarchitektur entlang des gesamten Kundenzyklus bis zum erfolgreichen Go-live. Du bist die zentrale Schnittstelle zwischen unseren Versicherungskunden und der EMIL Insurance Suite: Du entwickelst gemeinsam mit Kunden tragfähige E2E-Architekturen, überzeugst Entscheidungsträger auf C-Level und treibst die technische Transformation innerhalb unserer Customer-Delivery-Organisation aktiv voran. Du bist Teil unserer Customer Delivery…
- On-site
- Full-time
- Blue Card — tied; settle 21–33mo
Lead/Head of Talent Acquisition, Business & Tech (all genders)
Distribusion Technologies·Germany
About us Distribusion is the world’s leading ground transportation marketplace and gives travellers seamless access to ground transportation online, from search to ticket purchase. We have built a cutting-edge B2B technology platform that connects bus, rail, and ferry operators in 70+ countries with the biggest online retailers, including Google Maps and Booking.com. We are shaping the future of travel and…
- On-site
- Full-time
- Blue Card — tied; settle 21–33mo
Werkstudent:in im Price Lab des Dezernat Zukunft – Institut für Makrofinanzen (w/m/d, 10-20h/ Woche, zunächst befristet auf 1 Jahr)
Dezernat Zukunft·Berlin, Germany
Wer wir sind und was wir suchen Das Dezernat Zukunft ist ein überparteilicher Berliner Think Tank, der an der Schnittstelle von Politik, Verwaltung und Forschung arbeitet. Rund 30 Personen verfolgen gemeinsam das Ziel, Geld-, Finanz- und Wirtschaftspolitik neu zu denken und verständlich zu vermitteln. Dabei sind wir geleitet von unseren Grundwerten Würde, Wohlstand, Demokratie und Nachhaltigkeit. Zur Verstärkung des "Price…
- On-site
- Internship
- Blue Card — tied; settle 21–33mo
