Data Engineer
Accenture Bengaluru, Karnataka, India
Business Consulting and Services · 10,001+ employees
About the role
Design, develop, and maintain scalable Kafka-based data pipelines and real-time streaming applications. Collaborate with cross-functional teams to ensure high availability, performance tuning, and robust integration of data systems.
What they look for
Requirements
Requires a bachelor's degree in computer science, engineering, or IT. Candidates must have 3–5 years of experience in Kafka or real-time data streaming roles.
Full description
Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Apache Kafka Good to have skills : NA Minimum 2 year(s) of experience is required Educational Qualification : 15 years full time education
Job Title Kafka Developer (Apache Kafka / Streaming Engineer) Key Responsibilities Design, develop, and maintain scalable Kafka-based data pipelines and real-time streaming applications Build and manage Kafka producers, consumers, topics, partitions, and consumer groups Monitor, tune, and optimize Kafka cluster performance, throughput, and latency Troubleshoot and resolve issues related to data processing, message delivery, and system integrations Collaborate with application teams, data engineers, and DevOps teams to deliver robust integration solutions Develop and maintain Kafka Streams, KSQL, and Kafka Connect (source/sink connectors) implementations Ensure high availability, reliability, fault tolerance, and data consistency across Kafka platforms Implement security configurations, schema management (Avro/Protobuf), and data governance standards Create and maintain technical documentation for Kafka configurations, workflows, and architecture Provide production support, defect analysis (RCA), and performance tuning for Kafka-related applications Perform root cause analysis (RCA) for Kafka-related defects and integration failures Manage topic creation, schema evolution, and versioning strategies Work on event-driven architecture and microservices integration Qualifications Bachelor s degree in computer science / engineering / IT or related field 3–5 years of experience in Kafka or real-time data streaming roles Preferred Experience Experience in event-driven architecture and microservices design Exposure to CI/CD pipelines and DevOps tools (Docker, Kubernetes) Experience with monitoring tools like Prometheus, Grafana Experience in high-volume transaction systems or telecom/finance domains Key Deliverables Stable and scalable Kafka pipelines Low-latency data streaming solutions Effective troubleshooting and defect resolution Documentation and knowledge sharing Work Environment Agile development setup with cross-functional teams High dependency on integration systems (APIGEE, BWCE, microservices, etc.)
15 years full time education
About Accenture
Accenture is a leading global professional services company that helps the world’s leading businesses, governments and other organizations build their digital core, optimize their operations, accelerate revenue growth and enhance citizen services—creating tangible value at speed and scale. We are a talent- and innovation-led company with approximately 791,000 people serving clients in more than 120 countries. Technology is at the core of change today, and we are one of the world’s leaders in helping drive that change, with strong ecosystem relationships. We combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and global delivery capability. Our broad range of services, solutions and assets across Strategy & Consulting, Technology, Operations, Industry X and Song, together with our culture of shared success and commitment to creating 360° value, enable us to help our clients reinvent and build trusted, lasting relationships. We measure our success by the 360° value we create for our clients, each other, our shareholders, partners and communities.Visit us at www.accenture.com
Equal Employment Opportunity Statement
We believe that no one should be discriminated against because of their differences. All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, military veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by applicable law. Our rich diversity makes us more innovative, more competitive, and more creative, which helps us better serve our clients and our communities.
Similar roles
-
Senior Data Engineer - Healthcare Data & Audience Applications
Zeta Global Nashville, Tennessee, United States · $140K–$160K/yr
-
Senior Data Engineer (Databricks Migration)
Sigma Software Lisbon, Portugal
-
Senior Data Engineer (Retail Pricing AI)
Sigma Software Lisbon, Portugal
-
Senior Data Engineer
TriHealth Cincinnati, Ohio, United States
-
Senior Data Engineer
Devoteam Koerich, Capellen, Luxembourg
-
Data Engineer
Gore Mutual Insurance Cambridge, Ontario, Canada · CA$64K–CA$114K/yr