Sr. Platform Engineer - (Cloudera CDP & DevOps)

We are looking for an experienced Technology Engineer with strong expertise in Cloudera CDP, Hadoop ecosystem, DevOps, OpenShift, and CI/CD to support enterprise Technology Platforms & Data Platforms initiatives.

The ideal candidate should possess hands-on production support experience, platform engineering expertise, automation capabilities, and strong knowledge of containerized data platforms. This role requires ownership of Cloudera platform administration, performance optimization, infrastructure automation, observability, and CI/CD implementation within large-scale enterprise environments.

Key Responsibilities• Provide Tier-2 production support for enterprise Cloudera CDP environments.

• Install, configure, administer, and maintain Cloudera Data Platform (CDP) clusters.
• Perform installation, upgrades, patching, and maintenance of CDP 7.1.9 (or latest versions).
• Administer and support Cloudera Data Services (CDS) 1.5.4 / 1.5.5 and latest releases.
• Enable and maintain enterprise security controls across Cloudera CDP environments.
• Optimize Hadoop cluster performance, resource utilization, and overall platform stability.
• Collaborate with Data Engineering teams to optimize Spark workloads and improve application performance.
• Troubleshoot and resolve production issues related to:
• Spark Jobs
• Hive Jobs
• YARN Jobs

• Support CDP containerization using Cloudera Data Services.
• Design, develop, and maintain infrastructure automation for platform operations.
• Build and maintain automated CI/CD pipelines for analytics and data engineering workloads.
• Automate infrastructure provisioning, deployment, configuration management, and operational tasks.
• Implement observability, monitoring, logging, and alerting solutions for platform health.
• Automate security, compliance, and regulatory validation processes.
• Plan and execute automated patch management across enterprise environments.
• Work closely with Infrastructure, DevOps, Security, Data Engineering, and Platform teams to ensure reliable platform operations.
• Participate in Agile ceremonies and contribute to continuous engineering improvements.

Required Technical SkillsCloudera & Hadoop• Strong hands-on experience supporting Cloudera CDP production environments.

• Experience with:
• Cloudera Data Platform (CDP)
• CDP 7.1.9 or latest versions
• Cloudera Data Services (CDS) 1.5.4 / 1.5.5

• Hadoop ecosystem administration.
• Spark administration and performance optimization.
• Hive administration and troubleshooting.
• YARN administration and troubleshooting.
• Cluster installation, upgrades, maintenance, and optimization.

DevOps & AutomationStrong experience with:

• Ansible
• Shell Scripting
• Terraform
• Groovy
• Python automation

Experience developing infrastructure automation and operational workflows.

CI/CDHands-on experience building and managing automated pipelines using:

• GitHub Actions
• Jenkins
• ArgoCD

Experience implementing CI/CD for data engineering and analytics workloads.

Containers & Platform EngineeringHands-on experience with:

• Docker
• Podman
• Kubernetes
• OpenShift (OCP)

Experience deploying and managing containerized data platform environments.

Observability & MonitoringExperience implementing:

• Platform monitoring
• Logging
• Alerting
• Observability frameworks
• Performance monitoring

Security & InfrastructureExperience with:

• CDP security implementation
• Authentication & authorization
• Security hardening
• Automated security checks
• Regulatory compliance automation
• Automated patch management

Operating Systems & Version Control• Linux system administration

• Linux networking fundamentals
• Git version control
• Source code management best practices

Required Competencies• Strong production support experience within enterprise environments.

• Excellent troubleshooting and root cause analysis skills.
• Strong understanding of distributed data platforms.
• Ability to optimize platform performance and reliability.
• Strong ownership mindset with focus on operational excellence.
• Excellent communication and stakeholder collaboration skills.
• Ability to work effectively in Agile engineering environments.
• Experience working across Infrastructure, DevOps, and Data Engineering teams.
• Strong analytical and problem-solving capabilities.

Preferred Experience• Enterprise Data Platform Engineering.

• Large-scale Hadoop & Cloudera environments.
• Data Platform Operations.
• Platform Automation & Infrastructure as Code.
• DevOps Engineering.
• Cloud-native platform engineering.
• OpenShift-based enterprise deployments.