Yash Technologies

Data Engineer - Python Job

Yash Technologies Bangalore, Karnataka, India

IT Services and IT Consulting · 5,001-10,000 employees

8 h ago
python Senior (5-10 yrs) Full-time India
Create a free account to apply — email only, no card. You can also save this posting or score it against your profile with AI.

About the role

The candidate will be responsible for developing backend services, implementing business logic, and managing data pipelines using Python, Snowflake, and AWS. They will also oversee data request platforms, workflow orchestration, and ensure secure data governance within a regulated environment.

What they look for

Python Snowflake AWS Terraform REST API SQL Data modeling Snowpipe CI/CD Git Palantir Foundry Data engineering Infrastructure as Code RBAC ETL Workflow orchestration

Requirements

The role requires 5-7 years of experience in Python backend development, data schema modeling, and infrastructure management using Terraform. Proficiency in cloud-based data ingestion, CI/CD practices, and experience with Palantir Foundry or similar data platforms is essential.

Benefits

Flexible work arrangements Continuous learning Inclusive team environment

Full description

YASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences, and drive business transformation.

At YASH, we’re a cluster of the brightest stars working with cutting-edge technologies. Our purpose is anchored in a single truth – bringing real positive changes in an increasingly virtual world and it drives us beyond generational gaps and disruptions of the future.

We are looking forward to hire Python Professionals in the following areas :

Job description:

Experience required: 5-7 years

Core Technical Skills

  • Python
  • Backend service development and business logic implementation
  • Retry and error-handling mechanisms
  • Data schema modeling and validation using Pydantic
  • REST API development and request handling
  • SQL / Snowflake

  • MERGE and STREAM-based CDC pipeline development
  • Task scheduling and stored procedure implementation
  • Secure Views and Secure Data Sharing
  • Streaming data ingestion using Snowpipe and Snowpipe Streaming
  • RBAC, role management, and grant administration
  • Warehouse performance tuning and optimization
  • Terraform
  • Infrastructure as Code (IaC) for Snowflake resource provisioning
  • Database, role, warehouse, and grant management
  • Modular and reusable infrastructure deployments
  • Automated environment provisioning and standardization
  • AWS
  • Lambda-based event-driven ingestion workflows
  • S3 data lake storage architecture
  • Glue Data Catalog integration
  • IAM-based security and access control implementation
  • Palantir Foundry
  • Workshop-based GUI and application development
  • Backend workflow and process orchestration
  • Data request, approval, and provisioning workflows
  • Multi-stage approval lifecycle management with role-based ownership transitions
  • Version Control & CI Engineering
  • Git-based source control and branching strategies
  • Pre-commit hook framework implementation
  • Python linting and formatting using Ruff
  • Pull request templates and review governance
  • AI-assisted development workflows (Plan → Build → Review)

Data Modeling & Interchange Formats

  • JSON-based configuration and request schema design
  • Hierarchical and relational data modeling
  • Cross-platform data model synchronization

Platform & Domain Expertise

  • Enterprise Data Provisioning & Request Portals
  • End-to-end ownership of data request platforms
  • Palantir Foundry Workshop GUI development
  • Workflow orchestration and Python-based execution engines
  • Integration with Snowflake and AWS target platforms

Data Virtualization & Analytics Platform Integration

  • Output-port and ownership-privilege management
  • Source-to-target data model synchronization
  • Integration of hierarchical data structures across platforms

Industrial / OT Data Integration

  • Integration of Aveva PI process historian data
  • Event-driven ingestion pipelines using Lambda → Snowpipe → Snowflake
  • Secure data sharing architectures
  • OT entity modeling and governance framework design

Multi-Stage Approval Workflow Design

  • Workflow development in Palantir Foundry
  • Role-based approval and ownership handoffs
  • End-to-end request lifecycle management:
  • Requester
  • Data Steward
  • Data Owner
  • Engineering Team
  • Business Verification Team

Data Access Governance

  • Access request and approval workflow implementation
  • Role-Based Access Control (RBAC) design
  • Self-service data provisioning solutions
  • Business-owner-driven governance models
  • Regulated Environment Delivery
  • Dev → QA → Production deployment management
  • Controlled release and promotion workflows
  • Support for validated and GxP-equivalent environments

Compliance-focused system delivery and governance practices

At YASH, you are empowered to create a career that will take you to where you want to go while working in an inclusive team environment. We leverage career-oriented skilling models and optimize our collective intelligence aided with technology for continuous learning, unlearning, and relearning at a rapid pace and scale.

Our Hyperlearning workplace is grounded upon four principles

  • Flexible work arrangements, Free spirit, and emotional positivity
  • Agile self-determination, trust, transparency, and open collaboration
  • All Support needed for the realization of business goals,
  • Stable employment with a great atmosphere and ethical corporate culture

Similar roles