Sr. Platform Engineer - (Cloudera CDP & DevOps)

We are looking for an experienced Technology Engineer with strong expertise in Cloudera CDP, Hadoop ecosystem, DevOps, OpenShift, and CI/CD to support enterprise Technology Platforms & Data Platforms initiatives.

The ideal candidate should possess hands-on production support experience, platform engineering expertise, automation capabilities, and strong knowledge of containerized data platforms. This role requires ownership of Cloudera platform administration, performance optimization, infrastructure automation, observability, and CI/CD implementation within large-scale enterprise environments.

Key Responsibilities

• Provide Tier-2 production support for enterprise Cloudera CDP environments.
• Install, configure, administer, and maintain Cloudera Data Platform (CDP) clusters.
• Perform installation, upgrades, patching, and maintenance of CDP 7.1.9 (or latest versions).
• Administer and support Cloudera Data Services (CDS) 1.5.4 / 1.5.5 and latest releases.
• Enable and maintain enterprise security controls across Cloudera CDP environments.
• Optimize Hadoop cluster performance, resource utilization, and overall platform stability.
• Collaborate with Data Engineering teams to optimize Spark workloads and improve application performance.
• Troubleshoot and resolve production issues related to:
• Spark Jobs
• Hive Jobs
• YARN Jobs
• Support CDP containerization using Cloudera Data Services.
• Design, develop, and maintain infrastructure automation for platform operations.
• Build and maintain automated CI/CD pipelines for analytics and data engineering workloads.
• Automate infrastructure provisioning, deployment, configuration management, and operational tasks.
• Implement observability, monitoring, logging, and alerting solutions for platform health.
• Automate security, compliance, and regulatory validation processes.
• Plan and execute automated patch management across enterprise environments.
• Work closely with Infrastructure, DevOps, Security, Data Engineering, and Platform teams to ensure reliable platform operations.
• Participate in Agile ceremonies and contribute to continuous engineering improvements.

Required Technical Skills

Cloudera & Hadoop

• Strong hands-on experience supporting Cloudera CDP production environments.
• Experience with:
• Cloudera Data Platform (CDP)
• CDP 7.1.9 or latest versions
• Cloudera Data Services (CDS) 1.5.4 / 1.5.5
• Hadoop ecosystem administration.
• Spark administration and performance optimization.
• Hive administration and troubleshooting.
• YARN administration and troubleshooting.
• Cluster installation, upgrades, maintenance, and optimization.

DevOps & Automation

Strong experience with:

• Ansible
• Shell Scripting
• Terraform
• Groovy
• Python automation

Experience developing infrastructure automation and operational workflows.

CI/CD

Hands-on experience building and managing automated pipelines using:

• GitHub Actions
• Jenkins
• ArgoCD

Experience implementing CI/CD for data engineering and analytics workloads.

Containers & Platform Engineering

Hands-on experience with:

• Docker
• Podman
• Kubernetes
• OpenShift (OCP)

Experience deploying and managing containerized data platform environments.

Observability & Monitoring

Experience implementing:

• Platform monitoring
• Logging
• Alerting
• Observability frameworks
• Performance monitoring

Security & Infrastructure

Experience with:

• CDP security implementation
• Authentication & authorization
• Security hardening
• Automated security checks
• Regulatory compliance automation
• Automated patch management

Operating Systems & Version Control

• Linux system administration
• Linux networking fundamentals
• Git version control
• Source code management best practices

Required Competencies

• Strong production support experience within enterprise environments.
• Excellent troubleshooting and root cause analysis skills.
• Strong understanding of distributed data platforms.
• Ability to optimize platform performance and reliability.
• Strong ownership mindset with focus on operational excellence.
• Excellent communication and stakeholder collaboration skills.
• Ability to work effectively in Agile engineering environments.
• Experience working across Infrastructure, DevOps, and Data Engineering teams.
• Strong analytical and problem-solving capabilities.

Preferred Experience

• Enterprise Data Platform Engineering.
• Large-scale Hadoop & Cloudera environments.
• Data Platform Operations.
• Platform Automation & Infrastructure as Code.
• DevOps Engineering.
• Cloud-native platform engineering.
• OpenShift-based enterprise deployments.