Apache Airflow , Informatica , Snowflake, Azure services, Java design patterns, Data modelling, Spring boot,Strong Python Programming -6-9-CHN
Photon India
IT Services and IT Consulting · 5,001-10,000 employees
About the role
Design and implement batch and real-time data ingestion pipelines while building scalable ETL/ELT solutions. Develop RESTful APIs and microservices using Spring Boot to support cloud-native data solutions.
What they look for
Requirements
Requires 6-9 years of experience with strong proficiency in Java, Python, and data engineering frameworks. Candidates must have expertise in cloud data platforms, SQL, and containerization technologies like Kubernetes.
Full description
Location: CHN Experience: 6-9 Years
Key Skills: Apache Airflow , Informatica , Snowflake, Azure services, Java design patterns, Data modelling, Spring boot (Spring batch framework, Hibernate ORM ,Spring security) ,
Strong Python Programming around data libraries(Pandas,Numpy), Advanced Java , powerbi,Kubernetes(AKS), Github copilot agent development experience .
Skills around Data engineering and Spring boot :
Strong proficiency in SQL and data modeling.
Experience with Spark, Kafka, Hadoop, or similar technologies.
Expertise in cloud data platforms and services.
Experience in snowflake
Knowledge of CI/CD, DevOps, and automation practices.
Understanding of data governance, security, and privacy requirements.
Strong problem-solving and analytical capabilities.
Strong proficiency in Advance Java, Spring Boot, Spring MVC, and Spring Data.
Experience with microservices architecture and event-driven systems.
Working experience around Spring batch REST APIs, OpenAPI, and API security standards.
Familiarity with Kafka, RabbitMQ, or messaging frameworks.
Experience with containerization and cloud platforms (Docker, Kubernetes, Azure/AWS).
Understanding of DevSecOps, CI/CD, and agile development methodologies.
Strong debugging, troubleshooting, and performance optimization skills.
Key Responsibilities:
Design and implement batch and real-time data ingestion pipelines.
Build scalable ETL/ELT solutions using modern data engineering frameworks.
Develop and optimize data models, data lakes, and data warehouse architectures.
Ensure data quality, lineage, governance, and compliance standards.
Optimize performance, reliability, and scalability of data processing workflows.
Collaborate with cross-functional teams to define data requirements and solutions.
Implement monitoring, alerting, and operational controls for data platforms.
Support cloud-native data solutions across Azure.
Design and develop RESTful APIs and microservices using spring and Spring Boot.
Implement business logic and integration services for enterprise applications.
Build scalable and resilient distributed systems using cloud-native patterns.
Collaborate with architects, product owners, and QA teams throughout the SDLC.
Ensure code quality through unit testing, code reviews, and automated testing.
Optimize application performance, security, and reliability.
Implement observability through logging, monitoring, and tracing solutions in datadoog
Participate in CI/CD pipeline development(declarative pipeline using Jenkins core) and deployment automation.
Similar roles
-
PRINCIPAL QA SW ENGINEER 10380- Layer2/Layer3 Protocol Testing- Python |Data Center Networking
Extreme Networks Bengaluru, Karnataka, India
-
Lead Software Engineer - Gen AI - Python
Wells Fargo Bengaluru, Karnataka, India
-
SR QA SW ENGINEER 10381- Layer2/Layer3 Protocol Testing- Python |Data Center Networking
Extreme Networks Chennai, Tamil Nadu, India
-
Consultant, Software Engineer | Python ETL Technical Lead
Nationwide Columbus, Ohio, United States · $118K–$178K/yr
-
Intern Hardware Engineer (Embedded Systems and Python)
Qualcomm Tijuana, Baja California, Mexico
-
Python Application Developer with DevOps
Takeaway City of London, England, United Kingdom