JobCubby JobCubby
Sign up
Yash Technologies

Data Engineer - PySpark Job

Yash Technologies pune, Maharashtra, India

IT Services and IT Consulting · 5,001-10,000 employees

5 d ago
data-engineer Mid (2-5 yrs) Contractor India
Create a free account to apply — email only, no card. You can also save this posting or score it against your profile with AI.

Applying here? Try the free cover letter tool — paste this posting and your résumé, no account needed.

About the role

The contractor will develop and optimize ETL/ELT data flows from source systems into the Palantir Foundry data lake. They will also be responsible for creating technical documentation and participating in Scrum meetings for task planning and review.

What they look for

PySpark Python ETL ELT Palantir Foundry Data Engineering Data Lake Scrum Data Flow Documentation

Requirements

Candidates must have 2-5 years of experience in PySpark development. Proficiency in building data pipelines and working within a ticketing system for task management is required.

Benefits

Flexible work arrangements Continuous learning Stable employment

Full description

YASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences, and drive business transformation.

At YASH, we’re a cluster of the brightest stars working with cutting-edge technologies. Our purpose is anchored in a single truth – bringing real positive changes in an increasingly virtual world and it drives us beyond generational gaps and disruptions of the future.

We are looking forward to hire PySpark Professionals in the following areas :

Job description:

Experience required: 2-5 years

Senior Offshore PySpark Data Engineer - Medicom Program

Contractor will play a key role in migrating and/or building ETL/ELT processes in Client Palantir Foundry infrastructure under the Medicom project establishing Foundry as the primary Data Lake platform for The core Markets scope.

Key responsibilities include:

  • Data Flow and Data Lake Structure Creation: Developing and optimizing data flows from Source systems to data lake structures within Foundry using PySpark
  • Creating documentation on Python code created by Contractor in Client Confluence platform.
  • Estimation of tasks assigned via ticketing system to the Contractor and timely resolution of those assigned.
  • Participation in Scrum meetings of the team in order to plan the work and allow Contractor’s work review by Product Owner

At YASH, you are empowered to create a career that will take you to where you want to go while working in an inclusive team environment. We leverage career-oriented skilling models and optimize our collective intelligence aided with technology for continuous learning, unlearning, and relearning at a rapid pace and scale.

Our Hyperlearning workplace is grounded upon four principles

  • Flexible work arrangements, Free spirit, and emotional positivity
  • Agile self-determination, trust, transparency, and open collaboration
  • All Support needed for the realization of business goals,
  • Stable employment with a great atmosphere and ethical corporate culture

Similar roles