Data Engineer -Databricks - Tieto Tech Consulting (m/f/d)
Tieto pune, Maharashtra, India
Technology, Information and Internet · 10,001+ employees
Applying here? Try the free cover letter tool — paste this posting and your résumé, no account needed.
About the role
Design, develop, and maintain scalable data pipelines and Lakehouse solutions using Azure Databricks, PySpark, and SQL. Collaborate with architects and stakeholders to transform enterprise data into reliable, business-ready data products for manufacturing processes.
What they look for
Requirements
Requires 5–10 years of experience in data engineering with strong expertise in Azure Databricks, PySpark, and Delta Lake. Candidates should have experience with enterprise-scale ETL/ELT, data modeling, and manufacturing industry data.
Full description
Job Description
Databricks Data Engineer
Role Overview
We are looking for an experienced Databricks Data Engineer with 5–10 years of overall data engineering experience, including strong hands-on expertise in Azure Databricks, PySpark, SQL and Delta Lake.
The candidate capable of designing and developing scalable data pipelines and Lakehouse solutions. The role requires close collaboration with Data Architects, Business Analysts, Analytics teams and business stakeholders to transform enterprise data into reliable and business-ready data products.
Key Responsibilities
- Design, develop and maintain scalable data pipelines using Azure Databricks, PySpark, Python, SQL and Delta Lake.
- Implement Bronze, Silver and Gold Lakehouse data layers and reusable data-engineering frameworks.
- Develop complex ETL/ELT solutions involving SAP and other enterprise source systems.
- Ingest and transform data originating from SAP environments, applying appropriate business and transformation logic.
- Build data solutions supporting manufacturing business processes, reporting and analytics.
- Implement batch and incremental data-loading patterns, schema evolution, historical data handling and pipeline recovery.
- Develop and optimize complex Spark/PySpark workloads and SQL transformations for scalability and performance.
- Implement data-quality checks, validation, reconciliation, monitoring and exception handling.
- Develop analytical and dimensional data models, including Fact/Dimension and Star Schema models.
- Follow engineering best practices for Git, CI/CD, automated deployment, coding standards and documentation.
- Work with Data Architects and business stakeholders to translate technical and business requirements into scalable data solutions.
- Participate in design reviews, code reviews and continuous improvement of Databricks engineering practices.
Technical Skills & Certifications Essential Skills
- 5–10 years of experience in Data Engineering, Data Warehousing or Data Platform development.
- Strong hands-on experience with Azure Databricks.
- Strong development skills in PySpark, Apache Spark, Python and SQL.
- Good understanding of Delta Lake and Lakehouse architecture.
- Experience implementing Bronze, Silver and Gold / Medallion architecture.
- Strong experience developing enterprise-scale ETL/ELT and data pipelines.
- Experience with data modelling, including Fact/Dimension models and Star Schemas.
- Understanding of data quality, governance, metadata, lineage and security concepts.
- Experience with Git, CI/CD and DevOps practices for data-engineering solutions.
- Strong troubleshooting, performance optimization and problem-solving skills.
- Good communication skills and ability to work with globally distributed technical and business teams.
Good to have :
- Experience working with SAP as a source system and good understanding of SAP data extraction/integration scenarios.
- Manufacturing industry/customer experience is required, with an understanding of data associated with manufacturing business processes.
Certifications
- Databricks Certified Data Engineer Associate preferred.
- Databricks Certified Data Engineer Professional would be a strong advantage.
- Microsoft Azure/Data Engineering certifications are an added advantage.
- Databricks AI Certification - Good to have.
Additional Information
At Tieto, we believe in the power of diversity, equity, and inclusion. We encourage applicants of all backgrounds, genders (m/f/d), and walks of life to join our team, as we believe that this fosters an inspiring workplace and fuels innovation. Our commitment to openness, trust, and diversity is at the heart of our mission to create digital futures that benefit businesses, societies, and humanity.
Diversity, equity and inclusion | Sustainability | Tieto
Stay alert to recruitment scams:
- Tieto only communicates via @tieto.com email addresses.
• We never ask candidates to pay fees or share financial details during recruitment.
- If you receive a suspicious message claiming to be from Tieto, don't respond — verify it via our official careers site.
- For more information visit Important Advisory Regarding Recruitment Fraud | Tieto Blog
- Remote Type: Hybrid
- Job Area: Application and Product Development
- Business Unit: Tech Consulting
Similar roles
-
Data Engineer
Deploja AB Solna, Sweden
-
Senior Data Engineer för datakatalog
Avaron AB Stockholm, Stockholm, Sweden
-
Data Engineer
Higgsfield San Francisco, California, United States · $200K–$260K/yr
- Data Engineer
-
Data Engineer
Ecolab Inc. Bengaluru, Karnataka, India
-
Consultant - Data Engineer MarTech
Hemnet Stockholm, Stockholm County, Sweden