Yash Technologies

Sr. Software Engineer - AWS Data Pipeline Job

Yash Technologies Bangalore, Karnataka, India

IT Services and IT Consulting · 5,001-10,000 employees

Yesterday
Senior (5-10 yrs) Full-time India
Log in to apply, save this posting, or score it against your profile with AI.

About the role

Design and implement scalable data pipelines using AWS services like Glue, Lambda, and Step Functions. Manage data workflows, optimize performance, and ensure data quality and governance across relational and serverless storage.

What they look for

Python PySpark AWS Glue AWS Lambda AWS Step Functions AWS Athena AWS S3 AWS RDS MySQL SQL Data Engineering ETL Data Pipelines IAM Data Governance

Requirements

Requires 5+ years of experience in data engineering with strong proficiency in Python and PySpark. Candidates must have hands-on expertise in AWS data services and SQL.

Benefits

Flexible work arrangements Continuous learning Inclusive team environment

Full description

YASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences, and drive business transformation.

At YASH, we’re a cluster of the brightest stars working with cutting-edge technologies. Our purpose is anchored in a single truth – bringing real positive changes in an increasingly virtual world and it drives us beyond generational gaps and disruptions of the future.

We are looking forward to hire AWS Data Pipeline Professionals in the following areas :

AWS Data Developer (Python / PySpark)

Exp : 5+ Years

Job Summary

We are seeking a highly skilled AWS Data Developer with strong expertise in Python, PySpark, and AWS data services to design and build scalable data processing solutions. The ideal candidate will be responsible for developing robust ETL pipelines, optimizing data workflows, and leveraging AWS services to support business.

Key Responsibilities

  • Design and implement scalable data pipelines using AWS services
  • Develop ETL workflows using AWS Glue, PySpark, and Python
  • Build serverless data processing solutions using AWS Lambda
  • Orchestrate workflows using AWS Step Functions
  • Manage and optimize data storage in AWS S3
  • Work with relational databases like AWS RDS (MySQL)
  • Ensure data quality, validation, and governance
  • Optimize performance and cost of data pipelines
  • Debug and troubleshoot data-related issues
  • Collaborate with cross-functional teams (Data Analysts, Architects, DevOps)

Required Skills & Experience

  • 5+ years of experience in data engineering / AWS development
  • Strong proficiency in Python
  • Hands-on experience with PySpark for large-scale data processing
  • Expertise in AWS services:
  • AWS Glue (ETL jobs)
  • AWS Lambda
  • AWS Step Functions
  • AWS Athena
  • AWS S3
  • AWS RDS (MySQL)
  • Strong knowledge of SQL and data querying
  • Familiarity with IAM roles and AWS security best practices

Preferred Skills

  • AWS Certification (e.g., AWS Certified Data Engineer / Developer)
  • Experience with CI/CD pipelines and DevOps tools
  • Familiarity with Docker / Kubernetes

At YASH, you are empowered to create a career that will take you to where you want to go while working in an inclusive team environment. We leverage career-oriented skilling models and optimize our collective intelligence aided with technology for continuous learning, unlearning, and relearning at a rapid pace and scale.

Our Hyperlearning workplace is grounded upon four principles

  • Flexible work arrangements, Free spirit, and emotional positivity
  • Agile self-determination, trust, transparency, and open collaboration
  • All Support needed for the realization of business goals,
  • Stable employment with a great atmosphere and ethical corporate culture