Senior Data Engineer – Enterprise Data Hub (AWS + Snowflake + DBT + PySpark + CI/CD)
Ness Digital Engineering United States
Software Development · 1,001-5,000 employees
About the role
Design, develop, and maintain enterprise-scale data pipelines and metadata-driven transformation frameworks using AWS, Snowflake, and DBT. Collaborate with offshore teams to provide technical guidance while ensuring platform performance, data quality, and operational monitoring.
What they look for
Requirements
Requires over 10 years of data engineering experience with strong expertise in AWS, Snowflake, DBT, and PySpark. Candidates must possess advanced SQL skills and experience in dimensional data modeling and CI/CD deployment automation.
Full description
Job Description:
We are looking for an experienced Senior Data Engineer (10+ years of data engineering experience) to join the EDH team. This role will serve as a technical resource responsible for designing, developing, supporting, and enhancing modern data pipelines built using AWS, Snowflake, and DBT.
The ideal candidate should have strong hands-on experience building enterprise-scale data platforms, working with AWS, Snowflake cloud-based data engineering solutions, and supporting complex data integration and transformation processes. The candidate should be comfortable working independently, collaborating with offshore teams, and providing technical guidance.
Key Responsibilities:
- Design, develop, and support enterprise data pipelines using AWS, Snowflake, and DBT.
- Develop and enhance metadata-driven data ingestion and transformation frameworks.
- Work with AWS services to build scalable data ingestion solutions.
- Implement enterprise-scale solutions using Snowflake, including database design, data loading, data transformation, security, performance optimization, and operational support.
- Build dimensional models, star schema, snowflake schema, fact and dimension tables, and data structures optimized for analytics and reporting.
- Develop DBT models, macros, tests, and deployment configurations.
- Troubleshoot and debug data pipeline issues across AWS, Snowflake, dbt, and PySpark, perform root cause analysis, and implement solutions.
- Support EDH production deployments, monitoring, and issue resolution.
- Collaborate with offshore engineering teams and provide technical guidance and code reviews.
- Participate in architecture discussions and recommend improvements to platform design.
- Work with DevOps teams on CI/CD processes, Git-based development, deployment automation, and release management.
- Implement data quality checks, validation frameworks, logging, and operational monitoring.
Required Technical Skills:
AWS: Strong hands-on data engineering experience with AWS data services
Snowflake: Strong hands-on experience with Snowflake architecture, development,
Designing data warehouse solutions using Snowflake.
DBT: Strong hands-on experience with DBT development
PySpark: Experience developing PySpark applications for data ingestion and cleansing.
DevOps-CI/CD: Experience with deployment automation, release management, and
environment promotion processes.
Data Modeling: Experience designing dimensional data models (Facts, Dimensions).
transformation, and optimization in cloud-based data platforms.
SQL: Strong SQL skills including complex queries, performance tuning, and optimization.
Similar roles
-
Lead / Principal Data Engineer - DBT & Databricks
Encora Bolivia
-
Senior Data Engineer
Encora Bolivia
-
Lead Data Engineer
Encora Bolivia
-
Data Engineer
Royal Electric Dallas, Texas, United States · $93K–$119K/yr
-
Lead Data Engineer – Snowflake & Data Platforms
DTCC Jersey City, New Jersey, United States · $75K–$150K/yr
-
Senior, Data Engineer
DEPT® Municipio de Garupá, Misiones, Argentina