About the role
You will own the end-to-end movement and transformation of data from mainframe sources into AWS to enable downstream analytics. Responsibilities include designing ETL/ELT workflows, managing S3 storage, and automating deployments using CI/CD pipelines.
What they look for
Requirements
Candidates must have 5 or more years of professional data engineering experience with a focus on AWS Glue and data pipeline delivery. Strong proficiency in AWS services, Kafka, and automated workflow tools is required to succeed in this role.
Full description
About the Role
This is a fully hands-on individual contributor role on a data engineering team within the healthcare industry. You will own the end-to-end movement and transformation of data, from ingesting mainframe source streams into AWS through to provisioning clean, consumer-ready datasets. Your work directly enables downstream analytics and operational systems at scale.
What You'll Do
- Stream and process mainframe source data into AWS S3 using modern data pipeline tooling.
- Design and implement ETL/ELT workflows using AWS Glue to curate and transform data.
- Perform data reconciliation, validation, and quality checks across ingested datasets.
- Provision clean, consumer-ready datasets through AWS Aurora and RDS PostgreSQL databases.
- Manage S3 storage including data retention policies, archival strategies, and lifecycle management.
- Automate and deploy workflows using GitHub Actions and CI/CD pipelines.
- Leverage AI tools to improve engineering productivity and automate data workflows.
What We're Looking For
- 5 or more years of professional Data Engineering experience delivering data pipelines, ETL/ELT workflows, or data platform solutions.
- Hands-on production experience with AWS Glue for ETL/ELT design and implementation.
- Strong working knowledge of AWS S3, RDS, and Aurora in production environments.
- Demonstrated experience building and maintaining data streaming pipelines using Kafka.
- Experience implementing data reconciliation, data quality checks, and validation processes.
- Proficiency with GitHub repository management and GitHub Actions for CI/CD automation.
- Experience using AI tools to automate workflows and boost engineering productivity.
- Ability to own deliverables and drive work to completion with minimal oversight.
- Experience with mainframe data sources or legacy system integration is a plus.
- Familiarity with MongoDB or other NoSQL databases is a plus.
Compensation & Benefits
This is a W2 contract engagement. The bill rate is $65/hour.
Location
This role is 100% remote. Candidates based anywhere in the United States are welcome to apply.
Similar roles
-
Senior Data Engineer R&D
MSD Prague, Prague, Czechia
-
Sr Data Engineer
Porch Group India
-
FBS SAP Informatica Power Center Data Engineer
Capgemini Mexico
-
Forward Deployed Data Engineer
Total Performance Consulting Georgia, United States
-
Senior Data Engineer - Algolia
Perficient Bogota, RAP (Especial) Central, Colombia
-
Senior Data Engineer - Tableau
Perficient Bogota, RAP (Especial) Central, Colombia