JobCubby JobCubby
Sign up
Vrinda International

DATA ENGINEERING MANAGER

Vrinda International Noida, Uttar Pradesh, India · ₹2M/yr

Human Resources Services · 11-50 employees

4 d ago
engineering-manager Principal (10+ yrs) Full-time India
Create a free account to apply — email only, no card. You can also save this posting or score it against your profile with AI.

Applying here? Try the free cover letter tool — paste this posting and your résumé, no account needed.

About the role

The Data Engineering Manager will oversee the design, implementation, and optimization of scalable data pipelines and cloud-native data architectures. They will lead cross-functional teams to govern data lake environments and ensure high performance for both batch and real-time processing workloads.

What they look for

Data Engineering Apache Kafka MSK Data Lake Architecture Docker ECS EKS Terraform AWS CDK Avro Debezium CDC Streaming Data Infrastructure-as-code Data Governance Apache Pinot

Requirements

Candidates must possess 10 to 15 years of professional experience in data engineering with deep expertise in streaming architectures and containerization. Proficiency in infrastructure automation tools like Terraform and experience with data lake technologies are essential for this role.

Full description

Data Engineering Manager

Summary

We are seeking a seasoned Data Engineering Manager to lead our data infrastructure initiatives within the IT Services sector. This pivotal role involves overseeing the design, implementation, and optimization of scalable data pipelines and architectures. The successful candidate will drive strategic decisions regarding data lake frameworks, real-time streaming solutions, and cloud-native deployment strategies, ensuring robust data availability and integrity to support enterprise-wide analytics and business intelligence goals.

Responsibilities

  • Architect and govern large-scale data lake environments, ensuring high performance and reliability for both batch and real-time data processing workloads.
  • Lead the development and maintenance of streaming data solutions using Apache Kafka and MSK, integrating change data capture (CDC) mechanisms via Debezium.
  • Manage containerized data services and orchestration platforms, specifically utilizing ECS, EKS, and Docker to ensure seamless deployment and scaling.
  • Oversee infrastructure-as-code practices using Terraform and CDK to automate provisioning and manage cloud resources efficiently.
  • Direct the implementation of Avro serialization standards and optimize data ingestion patterns for complex analytical requirements.
  • Collaborate with cross-functional teams to define data engineering roadmaps, resolve technical bottlenecks, and enforce best practices in data governance.
  • Mentor senior engineers and foster a culture of technical excellence, code quality, and continuous improvement within the data engineering team.

Requirements

Requirements:

  • Possess 10 to 15 years of professional experience in data engineering, with a proven track record of managing complex data ecosystems.
  • Demonstrate deep expertise in streaming and batch processing architectures, with hands-on experience in Apache Kafka and MSK.
  • Proficiency in containerization and orchestration tools, including Docker, ECS, and EKS.
  • Strong command of infrastructure automation using Terraform or AWS CDK.
  • Extensive background in designing and maintaining Data Lake architectures, with specific knowledge of Avro and Debezium CDC.
  • Familiarity with real-time analytics engines such as Apache Pinot is highly desirable.
  • Ability to operate within the IT Services industry standards, delivering high-quality solutions that meet client and business needs.

Similar roles