Ness Digital Engineering

Senior Data Engineer – Enterprise Data Hub (AWS + Snowflake + DBT + PySpark + CI/CD)

Ness Digital Engineering United States

Software Development · 1,001-5,000 employees

3 d ago
data-engineer Principal (10+ yrs) Full-time United States
Log in to apply, save this posting, or score it against your profile with AI.

About the role

Design, develop, and maintain enterprise-scale data pipelines and metadata-driven transformation frameworks using AWS, Snowflake, and DBT. Collaborate with offshore teams to provide technical guidance while ensuring platform performance, data quality, and operational monitoring.

What they look for

AWS Snowflake DBT PySpark Data Engineering CI/CD Data Modeling SQL Data Pipelines Cloud Platforms Database Design Performance Tuning DevOps Data Warehousing Metadata-driven Frameworks Dimensional Modeling

Requirements

Requires over 10 years of data engineering experience with strong expertise in AWS, Snowflake, DBT, and PySpark. Candidates must possess advanced SQL skills and experience in dimensional data modeling and CI/CD deployment automation.

Full description

Job Description:

         We are looking for an experienced Senior Data Engineer (10+ years of data engineering experience) to join the EDH team. This role will serve as a technical resource responsible for designing, developing, supporting, and enhancing modern data pipelines built using AWS, Snowflake, and DBT.

The ideal candidate should have strong hands-on experience building enterprise-scale data platforms, working with AWS, Snowflake cloud-based data engineering solutions, and supporting complex data integration and transformation processes. The candidate should be comfortable working independently, collaborating with offshore teams, and providing technical guidance.

Key Responsibilities:

  • Design, develop, and support enterprise data pipelines using AWS, Snowflake, and DBT.
  • Develop and enhance metadata-driven data ingestion and transformation frameworks.
  • Work with AWS services to build scalable data ingestion solutions.
  • Implement enterprise-scale solutions using Snowflake, including database design, data loading, data transformation, security, performance optimization, and operational support.
  • Build dimensional models, star schema, snowflake schema, fact and dimension tables, and data structures optimized for analytics and reporting.
  • Develop DBT models, macros, tests, and deployment configurations.
  • Troubleshoot and debug data pipeline issues across AWS, Snowflake, dbt, and PySpark, perform root cause analysis, and implement solutions.
  • Support EDH production deployments, monitoring, and issue resolution.
  • Collaborate with offshore engineering teams and provide technical guidance and code reviews.
  • Participate in architecture discussions and recommend improvements to platform design.
  • Work with DevOps teams on CI/CD processes, Git-based development, deployment automation, and release management.
  • Implement data quality checks, validation frameworks, logging, and operational monitoring.

Required Technical Skills:

AWS: Strong hands-on data engineering experience with AWS data services

Snowflake: Strong hands-on experience with Snowflake architecture, development,  

         Designing data warehouse solutions using Snowflake.

DBT: Strong hands-on experience with DBT development

PySpark: Experience developing PySpark applications for data ingestion and cleansing.

DevOps-CI/CD: Experience with deployment automation, release management, and

    environment promotion processes.

Data Modeling: Experience designing dimensional data models (Facts, Dimensions).

                   transformation, and optimization in cloud-based data platforms.

SQL: Strong SQL skills including complex queries, performance tuning, and optimization.

Similar roles