M13 - Data Engineer
FPT Asia Pacific Pte Ltd Singapore, Singapore
IT Services and IT Consulting · 10,001+ employees
Applying here? Try the free cover letter tool — paste this posting and your résumé, no account needed.
About the role
Design, build, and maintain robust data pipelines and infrastructure using AWS services like Glue, Redshift, and S3. Collaborate with the IT department to implement CI/CD workflows, monitor system health, and ensure data quality through automated testing.
What they look for
Requirements
Requires a strong background in data engineering with proficiency in Python, SQL, and shell scripting. Candidates must have extensive experience with AWS data services, CI/CD pipelines, and Infrastructure as Code practices.
Full description
Responsibilities
Data Pipeline Development & Management
- Design, build, and maintain robust data pipelines using AWS Glue
- Implement ETL/ELT processes for data ingestion from multiple sources
- Optimize data workflows for performance and scalability
- Monitor and troubleshoot data pipeline failures and performance issues
Data Infrastructure & Engineering (with IPOS IT Department)
- Manage and optimize AWS Redshift data warehouse operations
- Configure and maintain data storage solutions (AWS S3, data lakes)
- Implement data partitioning, indexing, and compression strategies
- Support Infrastructure as Code (IaC) for data infrastructure deployment
CI/CD & DevOps for Data (with AWS partners and IPOS IT Department)
- Develop and maintain CI/CD pipelines for data workflows using GitLab
- Implement automated testing for data pipelines and data quality
- Support version control and deployment strategies for data assets
- Configure AWS Lambda functions for data processing automation
Monitoring & Support (with IPOS IT Department)
- Set up monitoring and alerting for data pipeline health
- Provide technical support for data-related issues
- Collaborate with technical teams on data architecture requirements
- Optimize query performance and database operations
Documentation & Reporting (with IPOS IT Department)
- Document data pipeline architectures and technical specifications
- Maintain runbooks and operational procedures
- Conduct monthly progress meetings (1 hour) to report on system health
- Track engineering tasks through SHIP-HATS Jira
- Maintain technical documentation on SHIP-HATS Confluence
Requirements
- Strong background in data engineering and data pipeline development
- Proficiency in SQL, Python, and shell scripting
- Extensive experience with AWS data services (Redshift, S3, Glue, Lambda, CloudWatch)
- Data warehouse design and optimization experience
- Strong CI/CD pipeline knowledge (GitLab preferred)
- Infrastructure as Code (IaC) experience (Terraform, CloudFormation)
- Knowledge of data modeling and database design principles
- Strong troubleshooting and performance optimization skills
Similar roles
-
Data Engineer
Medtronic Edinburgh, Scotland, United Kingdom · £77K–£115K/yr
-
Associate Data Engineer
AAA Costa Mesa, California, United States · $86K–$115K/yr
-
Senior Data Engineer
Clera Munich, Bavaria, Germany
-
Senior Data Engineer(BQ)
NTT DATA Romania SA Bucharest, Romania
-
Data Engineer
Takeda Bengaluru, Karnataka, India
-
Data Engineer Intern
PwC Prague, Prague, Czechia