Staff Data Engineer- Cloud Data Platform

ELLKAY started out providing connectivity solutions to laboratories and within a few years, grew to also provide data management solutions to ambulatory organizations. ELLKAY is now a trusted data management partner in five healthcare segments. ELLKAY’s solutions continue to serve laboratories and ambulatory practices and have expanded to empower hospitals and health systems, healthcare IT vendors, ambulatory practices, health plans, and other healthcare organizations with cutting-edge technologies and solutions that drive their growth and interoperability strategies.

Today, ELLKAY remains true to our core values, building strong partner relationships and offering unparalleled service and support while providing innovative, scalable solutions to the challenges our customers face in today’s data-rich world.

ELLKAY's experience, customer-focused approach, and reputation for innovation, speed, and accuracy differentiate ELLKAY as a premier partner for your interoperability needs and data management strategy.

Job Description:

The Staff Data Engineer – Cloud Data Platform will design, develop, and operate scalable cloud-based data pipelines and processing capabilities for ELLKAY’s shared Data Platform and Data Lake.

This is a hands-on engineering position responsible for converting the Data Platform architecture into production-ready ingestion, transformation, data-quality, and data-serving capabilities. The engineer will work with the Director, Staff Engineers, Architects, and product teams to onboard healthcare data workloads through reusable platform patterns.

Essential Duties & Responsibilities:

• Build scalable batch, incremental, streaming, and near-real-time data pipelines.

• Develop ingestion capabilities for databases, files, SFTP, APIs, healthcare messages, events, and partner data.

• Implement raw, standardized, curated, and product-serving data layers.

• Preserve original source data and maintain traceability between source and transformed records.

• Develop transformation, normalization, mapping, reconciliation, and validation workflows.

• Implement data-quality rules, exception handling, lineage, metadata, and audit controls.

• Build solutions using AWS, Snowflake, SQL, Python, Spark or equivalent cloud data technologies.

• Develop reusable pipeline templates, libraries, configuration patterns, and CI/CD components.

• Implement automated unit, integration, regression, reconciliation, and performance tests.

• Establish monitoring, logging, metrics, alerting, dashboards, and operational runbooks.

• Optimize data-processing performance, storage utilization, and cloud cost.

• Support healthcare migration, LKOasis, LKOpera, eMPI, interoperability, analytics, and AI/ML use cases.

• Participate in design reviews, code reviews, production support, root-cause analysis, and performance tuning.

• Produce clear technical documentation and onboarding instructions for reusable platform components.

• Mentor junior and mid-level data engineers without direct employee-management responsibility.

Qualifications:

• Strong hands-on experience in data engineering and cloud data platforms.

• Experience developing production-grade ingestion and transformation pipelines.

• Strong SQL and Python skills.

• Experience with AWS, Snowflake, Spark, or equivalent modern data technologies.

• Understanding of data quality, reconciliation, metadata, monitoring, and CI/CD.

• Experience working with large, complex, or regulated datasets.

• Healthcare data experience is preferred but not required.

Additional Information:

ELLKAY is committed to fostering a collaborative and high-performance work environment that supports innovation, teamwork, and professional growth. Most roles are designed to operate from our office locations to encourage effective collaboration and engagement across teams.Any alternative work arrangements may be considered at the company’s discretion based on role requirements and business needs.For more information about our company, please visit www.ELLKAY.com.ELLKAY is a Smoke-Free Workplace.

ELLKAY, LLC provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.