JobCubby JobCubby
Sign up
G

Data Engineer-II (Python / AWS)

GCC India · Hyderabad, Telangana, India

Financial Services · 5,001-10,000 employees

Yesterday
Mid (2-5 yrs) Full-time India
Log in to apply, save this posting, or score it against your profile with AI.

About the role

Design and maintain scalable party reference data services and cloud-native pipelines using AWS to support client onboarding and regulatory reporting. Collaborate with stakeholders to migrate legacy systems to the cloud and implement data mastering capabilities like deduplication and golden record creation.

What they look for

Python AWS Glue AWS Lambda EventBridge S3 RDS MSK Kinesis Snowflake Terraform Data Mastering API Development CI/CD Event-Driven Architecture Identity Resolution Postgres

Requirements

Requires 3+ years of experience in data engineering with a focus on enterprise party reference data and proficiency in AWS services. Candidates should have experience with relational data stores, Python, and modern DevOps practices like Terraform and CI/CD.

Full description

Where Ambition Meets Innovation

At LPL’s Global Capability Center, you'll find a collaborative culture where your voice matters, integrity guides every decision, and technology fuels progress. Your skills, talents, and ideas will redefine what's possible. LPL's success reflects its exceptional employees, who together pursue one noble purpose: empowering financial advisors to deliver personalized advice for all who need it. We’re proud to be expanding and reaching new heights in Hyderabad.

Join us as we create something extraordinary together.

Position Overview

LPL Financial is seeking an Engineer II to join our Reference Data Master team within the Data & Analytics organization. This role is ideal for a highly skilled, hands-on engineer with strong expertise in party reference data, cloud-native data platforms, and enterprise data engineering. You will play a critical role in designing, building, and maintaining scalable party data solutions that support key business initiatives including client onboarding, KYC/AML, regulatory reporting, and operational efficiency.

As a developer, you will work closely with technical leads, architects, and business stakeholders while mentoring junior engineers and contributing to engineering best practices.

Key Responsibilities

  • Design, develop, and maintain party reference data services and pipelines supporting clients, counterparties, issuers, and legal entities.
  • Build and enhance cloud-native data solutions using AWS services such as Glue, Lambda, EventBridge, S3, RDS (Aurora/Postgres), and MSK/Kinesis.
  • Contribute to modernization efforts by migrating legacy party data systems from on-premise platforms to scalable, cloud-based architectures.
  • Integrate and manage third-party data providers (e.g., S&P Global Markit, Dun & Bradstreet, KYC/AML vendors) to ensure accurate ingestion, enrichment, and synchronization of party data.
  • Implement data mastering capabilities including deduplication, survivorship rules, identity resolution, and golden record creation.
  • Develop and maintain APIs and data services to deliver party data to downstream systems such as CRM, trading, compliance, and reporting platforms.
  • Ensure data quality, reliability, and lineage through validation frameworks, monitoring, and metadata management.
  • Build resilient, observable systems with appropriate logging, alerting, and fault-tolerant design patterns.
  • Collaborate with architecture, security, and governance teams to ensure compliance with data privacy, regulatory, and cybersecurity standards.
  • Participate actively in Agile delivery processes including backlog refinement, sprint planning, code reviews, and production support.
  • Mentor junior developers and contribute to coding standards, design reviews, and engineering best practices.

Requirements:

  • 3+ years of experience in data engineering or software development with a focus on enterprise data platforms, including hands-on experience working with party or entity reference data domains.
  • Proficiency with AWS services including Glue, Lambda, EventBridge, S3, RDS (Aurora/Postgres), and MSK/Kinesis.
  • Experience with data mastering concepts such as identity resolution, source system prioritization, and golden record management.
  • Experience working with relational and cloud-native data stores, including Snowflake, Aurora, Postgres, MSSQL, or similar technologies.
  • Experience building data pipelines, APIs, and event-driven architectures (Python preferred), along with familiarity with CI/CD pipelines, infrastructure-as-code (Terraform preferred), and modern DevOps practices.
  • Problem-solving skills, the ability to work independently on complex technical challenges, effective communication skills, and the ability to collaborate across technical and business teams; AWS certification(s) are a plus.

Core Competencies

  • Understanding of party data concepts and regulatory use cases, including KYC, AML, and FATCA.
  • Experience designing and implementing secure, resilient, and maintainable data solutions.
  • Experience developing scalable data platforms and services.

Preferred Qualifications

  • Experience mentoring team members and supporting technical knowledge sharing.
  • Interest in evaluating and adopting new technologies and approaches to improve systems.

LPL Global Business Services, LLP - PRIVACY POLICY