D

Data Engineer Lead

DT One Manila, Metro Manila, Philippines

Oct 30
data-engineer Senior (5-10 yrs) Full-time Singapore
Create a free account to apply — email only, no card. You can also save this posting or score it against your profile with AI.

About the role

Design and build a highly reliable, scalable data lake and AI platform while developing tools to empower data scientists and engineers. Manage the migration of machine learning applications to production and architect infrastructure for Generative AI and LLM deployment.

What they look for

Data Engineering Python Java Scala SQL AWS Docker Spark Presto Hadoop Data Warehousing MLOps LangChain LlamaIndex Vector Databases Generative AI

Requirements

Requires expertise in large-scale data processing systems and proficiency in Python, Java, or Scala. Candidates must have hands-on experience with AWS, SQL, distributed processing systems, and modern MLOps frameworks.

Full description

About the role

DT One is seeking a highly driven, self-motivated Data Engineer Lead based in Singapore or Manila. Designing, developing, and maintaining a data and AI platform that works at scale. Collaborate with Engineering Leads, Engineers, Data Scientists, Business Analysts, and other teams within DTOne to deliver a high-performing system that addresses daily operational challenges and supports organizational scalability.

Key responsibilities

  • Design and build a highly reliable data lake operating at scale with a strong emphasis on data quality, integrity, and availability.
  • Build complex new data pipelines to continuously expand capabilities with new data sources.
  • Develop tools, internal libraries, automated ETL creation, and data exploration frameworks to empower Data Scientists, Business Analysts, and Engineers.
  • Migrate Machine Learning and Data Applications from POC/MVP stage to production grade (ensuring high availability, scalability, and security).
  • Architect and scale infrastructure for Generative AI, LLM deployment, model fine-tuning, and vector retrieval (RAG).
  • Monitor and maintain all data systems, including ETLs, Data Warehouses, and Data Applications.
  • Provide actionable insights on Data Governance, industry best practices, and large-scale processing.
  • Support cross-functional teams with guidance on data usage, processing, and platform adoption.

Qualifications and Experience

  • Expertise in medium- to large-scale data processing systems, preferably based on open-source systems or AWS services.
  • Strong software development skills in one or more languages such as Python, Java, or Scala.
  • Advanced knowledge of SQL and SQL Database administration.
  • Hands-on experience with AWS infrastructure and Docker frameworks.
  • Experience with distributed processing systems such as Spark, Presto, or Hadoop.
  • Solid background in Data Warehousing and Data Modeling.
  • Experience with MLOps frameworks, LLM orchestration tools (e.g., LangChain, LlamaIndex), and vector databases (e.g., Pinecone, Milvus, Qdrant).

The ideal candidate is someone who:

  • Has a bias towards action and shipping, starting small and growing iteratively.
  • Is obsessed with data compliance, security, quality, and integrity.
  • Is passionate about learning new technologies, languages, infrastructure, and data analysis to drive meaningful impact.
  • Stays creative and generates fresh ideas leveraging technical expertise.
  • Enjoys sharing knowledge through coaching, events, and collaboration.

Sound like you? Apply now!

Similar roles