About the role

Build and optimize scalable data pipelines and analytical datasets on an AWS-based lakehouse platform. Develop batch ingestion workflows and maintain Apache Iceberg datasets while optimizing Athena query performance.

What they look for

Python SQL PySpark Spark AWS S3 AWS Glue AWS Athena DBT Airflow Apache Iceberg Hudi Delta Lake Parquet Optimization Data Pipeline Development Schema Evolution Data Validation

Requirements

Requires 4-5 years of data engineering experience with strong proficiency in Python, SQL, and PySpark. Must have hands-on experience with AWS Glue, Athena, DBT, Airflow, and familiarity with table formats like Apache Iceberg.

Full description

Opportunity Overview:

We are looking for a Data Engineer to build and optimize scalable data pipelines and analytical datasets on our AWS-based lakehouse platform.

You will work with Apache Iceberg, AWS Glue, Athena, dbt, and Airflow to support reliable and efficient data processing for analytics and operational use cases.

You will collaborate with senior engineers, analytics teams, and platform stakeholders to deliver production-grade data solutions.

What you’ll do:

Develop and maintain batch data pipelines

Build reusable ingestion and transformation workflows

Build and maintain Apache Iceberg datasets

Support schema evolution and partition optimization

Optimize Athena queries and troubleshoot performance bottlenecks

Implement data validation checks and monitoring

Support production issue troubleshooting

Required Qualifications:

4–5 years of experience in data engineering

Strong hands-on experience with Python, SQL, PySpark/Spark

Experience with AWS S3, Glue, Athena

Experience with DBT and Airflow (or equivalent)

Familiarity with Apache Iceberg / Hudi / Delta

Understanding of partitioning and Parquet optimization

Interview Process*:

Connect with Talent Acquisition

Technical Round 1

Technical Round 2

Final Round

*Subject to change

About Cohere Health:

Cohere Health’s clinical intelligence platform and agentic AI-powered solutions connect health plans’ strategic goals and providers’ needs, optimizing the speed, cost, and quality of care. With an enterprise approach that streamlines payer-provider decision-making across the care continuum–including policy, prior authorization, payment accuracy, and more–the company improves collaboration and reduces burden, resulting in up to 8x ROI and 94% provider satisfaction.

With the acquisition of ZignaAI, we expanded our AI-native platform with a comprehensive Payment Integrity Suite that spans data mining, clinical and coding validation, authorization and claims reconciliation, and end-to-end payment integrity services across pre- and post-pay workflows. By connecting clinical and payment insights, our transparent, AI-powered solutions help health plans proactively improve payment accuracy, reduce waste and vendor dependency, strengthen provider relationships, and build smarter, more efficient payment integrity programs.

Cohere Health’s innovations continue to receive industry-wide recognition. We’ve been recognized on TIME’s World Top HealthTech Companies 2025 list, the 2025 Inc. 5000 list, in the Gartner® Hype Cycle™ for U.S. Healthcare Payers (2022-2025), and ranked as a Top 5 LinkedIn™ Startup for 2023 & 2024.

We can’t wait to learn more about you and meet you at Cohere Health!

Equal Opportunity Statement:

Cohere Health is an Equal Opportunity Employer. We are committed to fostering an environment of mutual respect where equal employment opportunities are available to all. To us, it’s personal.