WAM-AWS-Data-Engineer-Senior
EY Gurgaon, Haryana, India
Professional Services · 10,001+ employees
About the role
Design, develop, and maintain scalable cloud-based data pipelines using AWS services like Glue, S3, and Airflow. Ensure data quality, lineage, and operational excellence while collaborating with cross-functional teams to support financial services applications.
What they look for
Requirements
Requires a bachelor's degree in a relevant field and 5-8 years of experience in data engineering with strong AWS exposure. Candidates must possess hands-on skills in Python, PySpark, SQL, and cloud-native data lake architectures.
Benefits
Full description
At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all.
WAM - AWS Data Engineer:
Consulting – WAM -Technical-AWS Data Engineer: Senior
At EY, we’re all in to shape your future with confidence.
We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go.
Join EY and help to build a better working world.
About Global Delivery Services
Global Delivery Services refers to EY's worldwide network of service delivery centers. The GDS team plays an important role in EY’s strategy by ensuring effective support to EY’s growth agenda.
Our journey started in 2002 with approximately 200 people. Today we stand at 80,000+ professionals in ten locations around the world. We operate in Argentina, China, Hungary, India, Philippines, Poland, Sri Lanka, Mexico, Spain and the United Kingdom.
Client service is focused on providing Consulting, Assurance, Tax, Strategy & Transactions, and Knowledge support to our clients around the world. The teams enable account teams worldwide to provide seamless, high-quality, value-added support, helping deliver exceptional client service.
Enablement Services provides cost-effective, high-skilled, and innovative services to support EY’s global and local enablement teams. Markets, BMC, AWS, Finance and Accounting, Risk Management, Procurement, People Shared Services, IT Service Delivery and IT Global Infrastructure services, are among the services offered by Enablement Services.
Our innovation specialists serve the GDS Client Service and Enablement Services teams, along with Service Lines, Core Business Services and Sectors. The team brings the desired environment, technologies and skilled teams together for facilitation, rapid prototyping and innovative thinking. The competencies offered include analytics, digital, user experience, mobile technology, infrastructure, Microsoft technologies and open innovation.
The Opportunity
Role Summary
We are seeking a highly skilled Senior AWS Data Engineer to design, develop, and support modern cloud-based data platforms on Amazon Web Services (AWS). The ideal candidate will have strong expertise in AWS data engineering technologies, Python/PySpark development, workflow orchestration, and data lake architectures, along with experience delivering scalable enterprise-grade data solutions.
The role involves building and maintaining data ingestion, transformation, and analytics pipelines supporting financial services applications, advisor platforms, reporting systems, and enterprise data initiatives. Candidates with prior experience in Wealth & Asset Management (WAM) domains will be highly preferred.
Role: AWS Data Engineer Senior
Experience: 5-8 years
Domain: Wealth Management, Asset Management, Capital Markets, Investment Banking, Financial
Your Key Responsibilities
Key Responsibilities
AWS Data Engineering & Development
- Design, develop, and maintain scalable data pipelines using AWS Glue (PySpark), Amazon S3, AWS Step Functions, and Athena.
- Build robust ETL/ELT solutions for batch and near real-time data processing.
- Develop reusable PySpark frameworks and data transformation components.
- Work closely with architects and business stakeholders to implement data platform requirements.
- Participate in migration and modernization initiatives from on-premises data platforms to AWS cloud environments.
Data Lake & Data Architecture
- Implement and support enterprise data lakes using Medallion Architecture (Bronze, Silver, Gold).
- Develop and maintain Apache Iceberg tables for efficient storage, schema evolution, and incremental processing.
- Ensure data quality, lineage, reconciliation, and auditability across the data platform.
- Contribute to data modeling and optimization efforts for analytical workloads.
Workflow Orchestration & Automation
- Develop and maintain Apache Airflow (MWAA) workflows and DAGs.
- Automate data movement, validation, monitoring, and notification processes.
- Implement retry mechanisms, dependency management, and failure handling within workflows.
- Integrate Airflow with AWS Glue, S3, Athena, and downstream applications.
AWS Cloud, Security & Infrastructure
- Implement AWS security best practices, including IAM roles, KMS encryption, and secrets management.
- Support infrastructure provisioning and deployment activities using Terraform.
- Collaborate with DevOps, infrastructure, and security teams to maintain secure and reliable cloud environments.
- Assist in configuring VPC endpoints, networking connectivity, and service integrations.
Production Support & Operational Excellence
- Monitor and troubleshoot production data pipelines and workflows.
- Perform performance tuning of AWS Glue jobs and Spark workloads.
- Implement logging, monitoring, and alerting using Amazon CloudWatch.
- Participate in incident resolution, root cause analysis, and continuous improvement initiatives.
- Ensure adherence to enterprise operational and governance standards.
Collaboration & Continuous Improvement
- Collaborate with cross-functional teams, including data architects, analysts, application teams, and business users.
- Participate in code reviews, design discussions, and technical documentation.
- Mentor junior engineers and share AWS data engineering best practices.
- Stay current with emerging AWS services and modern data engineering trends.
Preferred Domain Experience
Strong preference for candidates with experience in anyone:
- Wealth Management
- Asset Management
- Capital Markets
- Investment Banking
- Financial Services
Exposure to
- Portfolio & Investment Management
- Securities & Holdings Data
- Trade Processing
- Risk & Compliance Reporting
- Regulatory Reporting
- Market & Reference Data
- Advisor Compensation & Payout Platforms
- Client Reporting Solutions
Skills and attributes for success
Preferred Skills:
- AWS Data Engineering Services (Glue, EMR, Step Functions, S3, CloudWatch)
- Apache Airflow
- Redshift
- Iceberg
- DWH/ETL
- Python
- Pyspark
- Medallion Architecture
- SQL
- IaC (Devops, Terraform)
- WAM Domain Knowledge
- Github Copilot, Claude
Nice-to-Have Skills
- Experience with Oracle databases or ODI migrations.
- Knowledge of CI/CD pipelines and DevOps practices.
- Experience with data quality and metadata management tools.
- Familiarity with enterprise governance and regulatory compliance requirements.
- AWS Certification (Data Analytics, Solutions Architect, or Developer Associate).
What we look for
Required Qualifications
- Bachelor's degree in Computer Science, Engineering, Information Technology, or related discipline.
- 5-8 years of experience in Data Engineering with strong AWS exposure.
- Hands-on experience with AWS Glue, Amazon S3, Athena, MWAA (Apache Airflow), Step Functions, and CloudWatch.
- Strong programming skills in Python and PySpark.
- Experience building large-scale ETL/ELT data pipelines.
- Good understanding of data modelling, data warehousing, and distributed processing concepts.
- Experience working with Apache Iceberg and cloud-native data lake architectures.
- Experience using Infrastructure as Code tools such as Terraform.
- Strong SQL development and query optimization skills.
- Experience supporting production-grade data platforms and troubleshooting complex issues.
- Good understanding of AI technologies, agentic systems, and tools such as Microsoft Copilot and Claude, with the ability to leverage AI-driven capabilities for solution development and delivery.
What we offer you
At EY, we’ll develop you with future-focused skills and equip you with world-class experiences. We’ll empower you in a flexible environment, and fuel you and your extraordinary talents in a diverse and inclusive culture of globally connected teams. Learn more.
Are you ready to shape your future with confidence? Apply today.
To help create an equitable and inclusive experience during the recruitment process, please inform us as soon as possible about any disability-related adjustments or accommodations you may need.
Our Commitment: As a commitment, we persistently endeavour to embody our values, fulfil our purpose, and champion inclusiveness. Our dedication is to cultivate EY into an environment where diverse perspectives are celebrated, creating a supportive atmosphere for individuals to authentically be themselves and contribute their utmost.
Professional Development: From entry-level employees to senior leaders, we believe in continuous learning. We offer opportunities to build new skills, take on leadership roles, and connect and grow through mentorship.
People and Culture: In our dynamic workplace, diversity, equity, and inclusiveness are ingrained in our culture. We're united by a commitment to create an environment where every individual's differences are valued, practices are equitable, fostering a sense of belonging. Our shared values include integrity, respect, teaming, inclusiveness, energy, enthusiasm, courage to lead, and building relationships based on doing the right thing.
Benefits: Embark on a transformative career journey with us and indulge in a suite of premium benefits, encompassing exclusive health and wellness packages, enticing rewards, and cutting-edge learning opportunities that empower you to continually grow and excel in your professional and personal development.
How to Apply: If you are passionate to join us and are aligned with our commitment to building a better working world, we invite you to apply by completing our user-friendly form with personal and professional information and by providing your consent to data privacy.
Successful candidates advance to a competency-based interview. If mutual interest persists, a job offer awaits.
“We are an equal opportunity employer and are committed to Diversity, Equity & Inclusion”.
EY | Building a better working world
EY exists to build a better working world, helping to create long-term value for clients, people and society and build trust in the capital markets.
Enabled by data and technology, diverse EY teams in over 150 countries provide trust through assurance and help clients grow, transform and operate.
Working across assurance, consulting, law, strategy, tax and transactions, EY teams ask better questions to find new answers for the complex issues facing our world today.