State Street

AI Data & Knowledge Engineer – Senior Associate

State Street · Bengaluru, Karnataka, India

Financial Services · 10,001+ employees

Yesterday
Senior (5-10 yrs) Full-time India
Log in to apply, save this posting, or score it against your profile with AI.

About the role

Build and maintain scalable backend data pipelines and ETL/ELT workflows to support enterprise AI applications. Contribute to the development of RAG pipelines, knowledge graph assets, and semantic enrichment of enterprise data.

What they look for

Python SQL Java ETL/ELT Data Engineering Big Data Spark Databricks Data Pipelines RAG Vector Databases Knowledge Graphs Data Modeling Metadata Tagging Airflow Semantic Search

Requirements

Requires a bachelor's degree in Computer Science, Data Engineering, or a related field. Candidates should have up to 7 years of experience with proficiency in Python, SQL, and data integration concepts.

Benefits

Inclusive development opportunities Flexible work-life support Paid volunteer days Employee networks

Full description

About the Role 

We are looking for an AI Data & Knowledge Engineer with a strong foundation in data engineering and an interest in AI-powered data systems. This role will help build and maintain scalable backend data pipelines, ETL/ELT workflows, and structured knowledge assets that power enterprise AI applications. The ideal candidate will contribute to big data processing, data integration, retrieval pipelines, and knowledge graph foundations that enable reliable GenAI use cases. 

Key Responsibilities 

  • Build and maintain backend data pipelines to ingest, transform, and serve structured and unstructured data for AI applications. 
  • Support ETL/ELT workflows across enterprise source systems, data platforms, and downstream AI services. 
  • Assist in developing RAG pipelines, vector indexing workflows, and knowledge graph assets under guidance from senior engineers. 
  • Contribute to data modeling, ontology creation, metadata tagging, and semantic enrichment of enterprise data. 
  • Support MCP server integration and AI data enablement tasks for domain use cases. 
  • Perform data quality checks, validation, reconciliation, and documentation for pipelines and data contracts. 
  • Help optimize pipeline performance, reliability, and scalability across batch and near-real-time workloads. 
  • Participate in code reviews, sprint ceremonies, and engineering discussions to build platform and domain knowledge. 

Required Qualifications 

  • Bachelor’s degree in Computer Science, Data Engineering, Information Systems, or a related field. 
  • 0–7 years of experience in data engineering, software engineering, or a related technical role. 
  • Working knowledge of Python and SQL and/or Java. 
  • Basic understanding of ETL/ELT pipelines, data transformation, and data integration concepts. 
  • Exposure to big data or distributed processing tools such as Spark, Databricks, or similar platforms is preferred. 
  • Basic familiarity with data lakes, warehouses, or lakehouse architectures. 
  • Understanding of data quality, metadata, and governance concepts. 
  • Exposure to RAG, vector databases, semantic search, or knowledge graph concepts is a plus. 
  • Familiarity with orchestration tools such as Airflow or similar platforms is beneficial. 

About State Street

Across the globe, institutional investors rely on us to help them manage risk, respond to challenges, and drive performance and profitability. We keep our clients at the heart of everything we do, and smart, engaged employees are essential to our continued success.

We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you’ll benefit from inclusive development opportunities, flexible work-life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most. Join us in shaping the future.

As an Equal Opportunity Employer, we consider all qualified applicants for all positions without regard to race, creed, color, religion, national origin, ancestry, ethnicity, age, disability, genetic information, sex, sexual orientation, gender identity or expression, citizenship, marital status, domestic partnership or civil union status, familial status, military and veteran status, and other characteristics protected by applicable law.

Discover more information on jobs at StateStreet.com/careers

Read our CEO Statement