DevOps Data Hadoop Engineer – Kubernetes, CI/CD & Big Data

Job Summary

Synechron is seeking a DevOps Data Hadoop Technology Engineer with 7+ years of experience in DevOps, platform engineering, infrastructure management, and big data technologies.The role will design and manage CI/CD pipelines, containerized platforms, infrastructure as code, and distributed data solutions using Jenkins, GitOps, Kubernetes, OpenShift, Terraform, Ansible, Hadoop, Spark, and Kafka. The position will contribute to business objectives by improving deployment efficiency, platform reliability, data-processing performance, scalability, security, and operational resilience.

Software Requirements

Required

• Minimum 7+ years of experience in DevOps, platform engineering, infrastructure engineering, data engineering, or related technology roles.

• Experience designing, implementing, and managing CI/CD pipelines using Jenkins and related automation tools.

• Knowledge of GitOps principles and version-controlled application and infrastructure delivery.

• Experience deploying and managing containerized applications using Kubernetes and OpenShift.

• Experience developing and maintaining Infrastructure as Code using Terraform, Ansible, or equivalent tools.

• Hands-on experience with big data technologies such as Hadoop, Spark, and Kafka.

• Understanding of distributed data architectures, data processing, storage, scalability, fault tolerance, and high availability.

• Experience implementing monitoring, logging, alerting, and observability solutions.

• Knowledge of infrastructure, application, and data-platform security practices.

• Familiarity with governance standards, compliance requirements, change management, and operational support.

• Experience collaborating with development, operations, data engineering, infrastructure, and security teams.

• Ability to use current and supported versions of relevant tools and technologies based on project requirements.

Preferred

• Experience managing cloud-based Kubernetes, OpenShift, and big data platforms.

• Familiarity with automated testing, code quality checks, security scanning, and compliance controls in CI/CD pipelines.

• Experience with data lake, event-driven, batch, and streaming architectures.

• Knowledge of container security, image management, service mesh, and platform governance.

• Familiarity with deployment automation, configuration management, and infrastructure monitoring tools.

• Experience with capacity planning, disaster recovery, incident response, and platform resilience.

• Knowledge of cost optimization, resource efficiency, and sustainable infrastructure practices.

Overall Responsibilities

• Design, implement, and manage CI/CD pipelines using Jenkins, GitOps practices, and related automation tools.

• Automate the software development lifecycle from source-code integration through deployment and operational support.

• Deploy, configure, and manage containerized applications using Kubernetes and OpenShift.

• Develop, maintain, and automate infrastructure using Terraform, Ansible, or equivalent Infrastructure as Code tools.

• Architect, implement, and support big data platforms and solutions using Hadoop, Spark, Kafka, and related technologies.

• Design and manage distributed data architectures that support efficient, scalable, and fault-tolerant data processing and storage.

• Collaborate with development, operations, data engineering, infrastructure, and security teams to understand requirements and deliver robust technical solutions.

• Implement monitoring, logging, alerting, and observability for applications, infrastructure, containers, and data platforms.

• Optimize system performance, reliability, scalability, availability, and resource utilization.

• Troubleshoot deployment failures, infrastructure issues, container problems, data-processing errors, and platform incidents.

• Apply security best practices to infrastructure, applications, CI/CD pipelines, containers, and data platforms.

• Support governance, compliance, audit, change management, and operational readiness activities.

• Maintain technical documentation for pipelines, infrastructure, deployment procedures, platform configurations, and operational processes.

• Identify opportunities to improve automation, delivery efficiency, platform resilience, data processing, and sustainability.

• Ensure solutions meet agreed technical, security, operational, performance, and business requirements.

Technical Skills (By Category)

Programming Languages

Essential

• Ability to use scripting and programming languages for automation, deployment, configuration, and operational support.

• Understanding of command-line tools, build processes, configuration management, and automation concepts.

• Ability to read and modify pipeline scripts, deployment manifests, infrastructure definitions, and configuration files.

• Understanding of programming and implementation concepts relevant to distributed systems and data platforms.

Preferred

• Experience with Python, Bash, or another scripting language.

• Familiarity with Java, Scala, or another language used in big data environments.

• Experience developing reusable automation scripts, deployment utilities, and operational tools.

Databases/Data Management

Essential

• Understanding of Hadoop-based storage and distributed data processing.

• Experience supporting large-scale data storage, processing, movement, and retention.

• Knowledge of data availability, integrity, partitioning, replication, backup, and recovery.

• Understanding of batch and streaming data-processing requirements.

• Ability to support data platforms across development, testing, and production environments.

Preferred

• Experience with data lakes, data warehouses, and distributed file systems.

• Familiarity with structured, semi-structured, and unstructured data.

• Knowledge of data governance, metadata, lineage, retention, and data quality practices.

• Experience with data replication, disaster recovery, and platform capacity planning.

• Understanding of data security and privacy controls.

Cloud Technologies

Essential

• Understanding of cloud computing concepts, infrastructure, networking, storage, compute, and identity management.

• Knowledge of cloud-based container and data-platform deployment.

• Understanding of availability, scalability, monitoring, security, and cost considerations in cloud environments.

• Ability to support infrastructure and data solutions across cloud and on-premises environments.

Preferred

• Experience operating Kubernetes, OpenShift, Hadoop, Spark, or Kafka in cloud environments.

• Familiarity with cloud-managed container, storage, networking, monitoring, and data services.

• Experience with cloud infrastructure automation and platform provisioning.

• Knowledge of cloud cost optimization and sustainable resource utilization.

Frameworks and Libraries

Essential

• Hadoop for distributed storage and data-processing environments.

• Apache Spark for large-scale data processing.

• Apache Kafka for event streaming and distributed messaging.

• Kubernetes for container orchestration.

• OpenShift for enterprise container platform management.

• Familiarity with deployment manifests, configuration files, service definitions, and infrastructure modules.

Preferred

• Experience with Spark batch and streaming workloads.

• Knowledge of Kafka topics, partitions, consumer groups, retention, and delivery patterns.

• Familiarity with Kubernetes operators, Helm charts, ingress, services, configuration management, and persistent volumes.

• Experience developing reusable Terraform modules and Ansible roles.

• Knowledge of service mesh, container registries, and platform automation frameworks.

Development Tools and Methodologies

Essential

• Jenkins and CI/CD pipeline development.

• Git-based source control and GitOps delivery practices.

• Terraform or Ansible for Infrastructure as Code and configuration management.

• Experience with build automation, deployment automation, environment promotion, and release controls.

• Knowledge of Agile or iterative software delivery practices.

• Familiarity with issue tracking, documentation, change management, incident management, and operational support.

• Experience with monitoring, logging, alerting, and performance analysis tools.

Preferred

• Experience implementing automated testing, code quality checks, vulnerability scanning, and compliance controls in pipelines.

• Familiarity with declarative deployment, pull-based delivery, and configuration drift management.

• Knowledge of observability practices, dashboards, tracing, incident response, and service-level monitoring.

• Experience with disaster recovery testing, capacity planning, and platform resilience assessments.

• Familiarity with automated infrastructure validation and policy enforcement.

Security Protocols

Essential

• Understanding of secure infrastructure and secure software delivery principles.

• Knowledge of authentication, authorization, identity and access management, encryption, secrets management, and secure connectivity.

• Ability to apply security controls to CI/CD pipelines, container platforms, infrastructure, and data environments.

• Awareness of vulnerability management, audit logging, image security, and secure configuration practices.

• Understanding of data protection, confidentiality, integrity, availability, and regulatory requirements.

Preferred

• Experience with container image scanning, runtime security, network policies, and platform hardening.

• Familiarity with role-based access control, secrets vaults, certificate management, and policy enforcement.

• Knowledge of security testing and compliance validation within CI/CD pipelines.

• Experience supporting security reviews, risk assessments, remediation activities, and audit requirements.

Experience Requirements

• Minimum 7+ years of experience in DevOps, platform engineering, infrastructure engineering, data engineering, or related technology roles.

• Experience designing and managing CI/CD pipelines using Jenkins and Git-based delivery practices.

• Experience applying GitOps principles to application and infrastructure deployment.

• Experience deploying and managing containerized applications using Kubernetes and OpenShift.

• Experience developing Infrastructure as Code using Terraform, Ansible, or equivalent technologies.

• Hands-on experience with Hadoop, Spark, and Kafka.

• Experience designing or supporting distributed data architectures.

• Experience implementing monitoring, logging, alerting, observability, performance optimization, and operational support.

• Experience troubleshooting platform, deployment, infrastructure, container, and data-processing issues.

• Experience collaborating with development, operations, data, infrastructure, and security teams.

• Experience working in enterprise, regulated, financial services, or data-intensive environments is preferred.

• Candidates may also qualify through equivalent practical experience, relevant certifications, professional training, or demonstrated delivery of complex DevOps and big data platforms.

Day-to-Day Activities

• Design, maintain, and improve Jenkins and GitOps-based CI/CD pipelines, infrastructure automation, deployment configurations, and environment promotion processes.

• Deploy and support containerized applications and big data workloads across Kubernetes, OpenShift, and related infrastructure environments.

• Collaborate with development, operations, data engineering, infrastructure, and security teams through planning sessions, technical reviews, incident discussions, and delivery activities.

• Monitor platform performance, investigate incidents, optimize resources, maintain documentation, and make implementation decisions within established security and operational standards.

Qualifications

• Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field; equivalent professional experience may be considered.

• Minimum 7+ years of experience in DevOps, infrastructure engineering, data engineering, platform engineering, or related technology roles.

• Certifications in Kubernetes, cloud computing, DevOps, Infrastructure as Code, big data, or security are preferred.

• Complete Synechron-required training related to information security, data protection, workplace conduct, risk management, and responsible technology use.

• Maintain continuous professional development in CI/CD, GitOps, Kubernetes, OpenShift, Terraform, Ansible, Hadoop, Spark, Kafka, cloud technologies, monitoring, and security.

Professional Competencies

• Critical thinking, systems analysis, technical investigation, and structured problem-solving.

• Cross-functional collaboration, technical ownership, knowledge sharing, and delivery accountability.

• Clear communication with technical and non-technical stakeholders.

• Adaptability, continuous learning, and effective response to evolving platforms and operational requirements.

• Innovation focused on automation, reliability, scalability, security, and sustainable infrastructure practices.

• Effective prioritization, organization, time management, incident response, and delivery focus.

S​YNECHRON’S DIVERSITY & INCLUSION STATEMENT  

Diversity & Inclusion are fundamental to our culture, and Synechron is proud to be an equal opportunity workplace and is an affirmative action employer. Our Diversity, Equity, and Inclusion (DEI) initiative ‘Same Difference’ is committed to fostering an inclusive culture – promoting equality, diversity and an environment that is respectful to all. We strongly believe that a diverse workforce helps build stronger, successful businesses as a global company. We encourage applicants from across diverse backgrounds, race, ethnicities, religion, age, marital status, gender, sexual orientations, or disabilities to apply. We empower our global workforce by offering flexible workplace arrangements, mentoring, internal mobility, learning and development programs, and more.

All employment decisions at Synechron are based on business needs, job requirements and individual qualifications, without regard to the applicant’s gender, gender identity, sexual orientation, race, ethnicity, disabled or veteran status, or any other characteristic protected by law.

Candidate Application Notice