B
Data Engineer
Bonami Software Private Limited · Noida, Uttar Pradesh, India
IT Services and IT Consulting · 51-200 employees
4 d ago
Mid (2-5 yrs)
Full-time
India
Log in
to apply, save this posting, or score it against your profile with AI.
About the role
Design, build, and maintain scalable ETL/ELT data pipelines using Python and PySpark. Collaborate with cross-functional teams to optimize SQL queries and ensure data quality and integrity across Databricks and Snowflake.
What they look for
Python
PySpark
SQL
Databricks
Snowflake
ETL/ELT
Data Pipeline Development
Data Warehousing
PyTorch
Cloud Platforms
Requirements
Requires a Bachelor's degree in Computer Science or a related field with strong proficiency in Python, PySpark, and SQL. Experience with Databricks, Snowflake, and data warehousing concepts is essential.
Full description
- Design, build, and maintain scalable ETL/ELT data pipelines.
- Develop data processing workflows using Python and PySpark.
- Work with Databricks and Snowflake for data storage, transformation, and analytics.
- Integrate data from multiple sources while ensuring data quality and integrity.
- Optimize SQL queries and improve data pipeline performance.
- Collaborate with Data Analysts, Data Scientists, and Software Engineers to deliver data solutions.
- Monitor, troubleshoot, and maintain data workflows.
- Document data models, pipelines, and technical processes.
Requirements
- Bachelor's degree in Computer Science, Information Technology, Data Science, or a related field.
- Strong proficiency in Python, PySpark, and SQL.
- Hands-on experience with Databricks and Snowflake.
- Good understanding of ETL/ELT pipeline development.
- Familiarity with PyTorch is an added advantage.
- Knowledge of data warehousing concepts and cloud platforms is preferred.
- Strong analytical and problem-solving skills.
- Excellent communication and teamwork abilities.
