
Azure Data Engineer
This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for an Azure Data Engineer based in Germany.
This role offers the opportunity to strengthen cybersecurity operations by engineering reliable, scalable security data pipelines across cloud and on-premises environments.
You will work with high volumes of security telemetry and help ensure critical data is available for threat detection, incident response, compliance, and cyber risk visibility.
The position combines hands-on data engineering with cybersecurity, cloud technologies, automation, and data quality management.
You’ll collaborate with application, infrastructure, security, governance, and vendor teams to onboard and optimize diverse data sources.
The role is well suited to an engineer who enjoys troubleshooting complex ingestion challenges and improving system reliability and efficiency.
You’ll operate in a highly regulated financial services environment where data integrity, security, and operational excellence are essential.
This is an opportunity to make a direct impact on the organization’s ability to detect, investigate, and respond to cyber threats.
Accountabilities:
- Design, build, and maintain scalable security data ingestion pipelines for SIEM and cloud data platforms, including Azure Data Explorer and Log Analytics.
- Parse, normalize, transform, enrich, and validate structured and unstructured security telemetry using regex, JSON parsing, schema mapping, and other data-processing techniques.
- Partner with application owners, infrastructure and cloud teams, vendors, security stakeholders, and other internal groups to onboard new log sources and validate end-to-end data flows.
- Ensure the integrity, completeness, timeliness, and quality of security telemetry used for monitoring, detection, incident response, reporting, and risk management.
- Align security data with established schemas, naming conventions, governance standards, and organizational requirements to support downstream analytics and automation.
- Troubleshoot ingestion, parsing, transformation, schema, and data-quality issues across diverse platforms and environments.
- Maintain clear documentation covering log onboarding procedures, source requirements, data mappings, pipeline configurations, and operational support processes.
- Collaborate with detection engineering and security operations teams to ensure telemetry supports investigation, threat detection, response, and cyber risk use cases.
- Conduct telemetry gap analyses, identify missing or incomplete data sources, and recommend priorities for improving security coverage.
- Support logging practices that meet regulatory, audit, compliance, retention, and data-integrity requirements.
- Improve ingestion frameworks, automation, and onboarding processes to increase scalability, repeatability, reliability, and cost efficiency.
- Support infrastructure-as-code, scripting, and automation initiatives that streamline deployment and ongoing pipeline maintenance.
- Monitor pipeline performance and work with stakeholders to optimize ingestion reliability, throughput, and operational costs.
- Stay current with emerging cybersecurity telemetry formats, logging standards, data engineering practices, and cloud security data-platform capabilities.
- 3+ years of relevant experience in cybersecurity, data engineering, log management, security operations, or a related technology discipline.
- Hands-on experience onboarding, managing, and validating log sources within SIEM, cloud data platforms, or security analytics environments.
- Strong understanding of data parsing, normalization, transformation, and validation, including experience with regex, JSON, XML, CSV, and both structured and unstructured data.
- Familiarity with security telemetry from network, endpoint, identity, application, cloud, and infrastructure environments.
- Experience working with cloud platforms and associated logging, monitoring, and analytics services, particularly within the Azure ecosystem.
- Strong troubleshooting and analytical skills, with the ability to diagnose pipeline, ingestion, schema, and data-quality problems.
- Understanding of compliance and regulatory requirements related to logging, retention, auditability, and data integrity.
- Experience with scripting or automation technologies such as Python, PowerShell, or similar tools is preferred.
- Familiarity with query languages used to validate, investigate, and analyze ingested security data.
- Ability to coordinate complex onboarding initiatives across internal teams, vendors, and multiple stakeholders.
- Strong organizational skills and the ability to balance operational support, project delivery, and continuous improvement.
- Exceptional attention to detail and a strong sense of ownership for data quality and technical outcomes.
- Broader cybersecurity experience in areas such as threat detection, incident response, vulnerability management, or cloud security is an advantage.
- Strong communication, collaboration, judgment, and accountability, with the ability to work effectively within global teams.
- Remote work opportunity from anywhere.
- Opportunity to work on cybersecurity data engineering within a highly regulated financial services environment.
- Exposure to large-scale security telemetry, SIEM platforms, Azure data services, cloud environments, and security operations.
- Hands-on opportunities to develop scalable pipelines, automation, infrastructure-as-code, and data-quality solutions.
- Cross-functional collaboration with cybersecurity, cloud, infrastructure, application, governance, and vendor teams.
- Opportunity to contribute directly to threat detection, incident response, compliance, and cyber risk visibility.
- Professional growth through exposure to evolving cloud security, telemetry, and data engineering technologies.
- A collaborative global working environment with opportunities to solve complex technical challenges.
Requirements:
Benefits:
Find more English Speaking Jobs in Germany on Arbeitnow
Skills
- IT
Similar roles
Growth & Operations Intern (w/m/d)
Enpal·Berlin, Germany
Unser Ziel ist eine Solaranlage auf jedem Dach, ein Speicher in jedem Haus und ein E-Auto in jeder Garage. Enpal macht das möglich mit einer integrierten Gesamtlösung für dezentrale Energie – von Solaranlage und Batteriespeicher über Wallbox, Smart Meter bis zur Wärmepumpe. Herzstück ist unsere KI-gestützte Plattform Enpal.One+, die tausende Systeme intelligent vernetzt und Strombezug sowie -einspeisung effizient am Energiemarkt…
- On-site
- Full-time
- Blue Card — tied; settle 21–33mo
Baubegleiter:in | Home Office | (w/m/d)
Enpal·Berlin, Germany
Unser Ziel ist eine Solaranlage auf jedem Dach, ein Speicher in jedem Haus und ein E-Auto in jeder Garage. Enpal macht das möglich mit einer integrierten Gesamtlösung für dezentrale Energie – von Solaranlage und Batteriespeicher über Wallbox, Smart Meter bis zur Wärmepumpe. Herzstück ist unsere KI-gestützte Plattform Enpal.One+, die tausende Systeme intelligent vernetzt und Strombezug sowie -einspeisung effizient am Energiemarkt…
- On-site
- Full-time
- Blue Card — tied; settle 21–33mo
Operations Manager:in | Home Office | (w/m/d)
Enpal·Berlin, Germany
Unser Ziel ist eine Solaranlage auf jedem Dach, ein Speicher in jedem Haus und ein E-Auto in jeder Garage. Enpal macht das möglich mit einer integrierten Gesamtlösung für dezentrale Energie – von Solaranlage und Batteriespeicher über Wallbox, Smart Meter bis zur Wärmepumpe. Herzstück ist unsere KI-gestützte Plattform Enpal.One+, die tausende Systeme intelligent vernetzt und Strombezug sowie -einspeisung effizient am Energiemarkt…
- On-site
- Full-time
- Blue Card — tied; settle 21–33mo
Account Manager:in | Home Office | (w/m/d)
Enpal·Berlin, Germany
Unser Ziel ist eine Solaranlage auf jedem Dach, ein Speicher in jedem Haus und ein E-Auto in jeder Garage. Enpal macht das möglich mit einer integrierten Gesamtlösung für dezentrale Energie – von Solaranlage und Batteriespeicher über Wallbox, Smart Meter bis zur Wärmepumpe. Herzstück ist unsere KI-gestützte Plattform Enpal.One+, die tausende Systeme intelligent vernetzt und Strombezug sowie -einspeisung effizient am Energiemarkt…
- On-site
- Full-time
- Blue Card — tied; settle 21–33mo
Senior Agentic AI Engineer
Cube·Berlin, Germany
CUBE are a global RegTech business defining and implementing the gold standard of regulatory intelligence for the financial services industry. We deliver our services through intuitive SaaS solutions, powered by AI, to simplify the complex and everchanging world of compliance for our clients. Why us? 🌍 CUBE is a globally recognized brand at the forefront of Regulatory Technology. Our industry-leading…
- On-site
- Full-time
- Blue Card — tied; settle 21–33mo
Senior IT & OT Systems Specialist (gn)
Workidentity·Hamburg, Germany
Einleitung Du möchtest die Verbindung zwischen Produktion und IT aktiv gestalten und dabei moderne Technologien, Automatisierung und Industrie-4.0-Lösungen vorantreiben? Dann könnte diese Position genau dein nächster Karriereschritt sein. Unser Auftraggeber ist eine international erfolgreiche Unternehmensgruppe mit weltweiten Produktions- und Vertriebsstandorten. Innovation, Digitalisierung und kontinuierliche Weiterentwicklung sind fest in der Unternehmenskultur verankert. Dich erwartet ein engagiertes IT-Team, spannende Projekte und die…
- On-site
- Full-time
- Blue Card — tied; settle 21–33mo
Senior Microsoft Dynamics 365 Business Central Specialist (gn)
Workidentity·Hamburg, Germany
Einleitung Gestalte die digitale Zukunft eines international erfolgreichen FamilienunternehmensDu möchtest Verantwortung übernehmen, Prozesse aktiv verbessern und die Weiterentwicklung einer modernen ERP-Landschaft vorantreiben? Dann könnte diese Position genau das Richtige für dich sein. Unser Auftraggeber ist eine international tätige Unternehmensgruppe mit einer langen Erfolgsgeschichte, hoher wirtschaftlicher Stabilität und einem starken Wachstumskurs. Durch die Vielfalt seiner Geschäftsbereiche verbindet das Unternehmen Tradition und…
- On-site
- Full-time
- Blue Card — tied; settle 21–33mo
Director Product Technology Distribution Transformer (m/f/d)
SGB-SMIT Group·Regensburg, Germany
TRANSFORM WITH US THE FUTURE OF ENERGY ⚡ The SGB‑SMIT Group is an international transformer manufacturer with locations in Europe, Asia and America. With reliable transformer technology, the company actively supports the global energy transition in areas such as renewable energy, industry and urban energy infrastructure. As a key link between power generation, transmission and distribution, SGB‑SMIT Group develops and…
- On-site
- Full-time
- Blue Card — tied; settle 21–33mo