Nationwide IT Services

Data Engineer / Azure Databricks Engineer - Senior

Nationwide IT Services Andrews AFB, Maryland, United States · $150K–$188K/yr

IT Services and IT Consulting · 201-500 employees

19 h ago
data-engineer Senior (5-10 yrs) Full-time United States
Log in to apply, save this posting, or score it against your profile with AI.

About the role

The Senior Data Engineer will design, build, and optimize scalable ETL/ELT pipelines and data repository workloads within the Azure Databricks environment. This role involves developing data transformations, implementing automated quality controls, and ensuring robust performance and observability for mission-critical data.

What they look for

Azure Databricks SQL Python ETL/ELT pipelines Data engineering CI/CD Git Data quality Data lineage Cloud data services API integration Performance tuning Orchestration Data transformation Technical documentation

Requirements

Candidates must possess at least 8 years of professional experience and a bachelor's degree in a relevant technical field. Proficiency in SQL, Python, and Azure data engineering services is required, along with the ability to obtain and maintain a SECRET security clearance.

Benefits

Medical insurance Dental insurance Vision insurance Life insurance Disability insurance 401(k) plan with employer match Paid holidays Paid time off Commuter benefits Employee assistance program Educational reimbursement Pet insurance

Full description

Senior Data Engineer / Azure Databricks Engineer 

LocationJoint Base Andrews, MD / Hybrid as authorized

Security Clearance RequirementSECRET eligibility/clearance as required

Position Summary

Nationwide IT Services, NIS, is seeking a Senior Data Engineer / Azure Databricks Engineer to support Air National Guard Chief Data and Artificial Intelligence Office (ANG CDAO) Support Services. The Senior Data Engineer will design, build, deploy, and optimize enterprise data pipelines and repository workloads in Azure Databricks. This role supports moving and transforming CDAO mission data while strengthening data quality, observability, performance, and repeatable delivery practices.  Key Responsibilities

  • Design, develop, test, deploy, maintain, and optimize scalable ETL/ELT pipelines and Databricks workloads.
  • Develop SQL and Python transformations, notebooks, jobs, and orchestration routines for scheduled and event-driven processing.
  • Implement automated data-quality checks, reconciliation controls, exception handling, quarantine processes, and recovery procedures.
  • Create and maintain source-to-target mappings, data lineage, technical documentation, operating procedures, and runbooks.
  • Integrate APIs, files, databases, and cloud data services across DAF, ANG, DoD, and CDAO platforms.
  • Implement Git-based version control, CI/CD automation, testing, monitoring, alerting, and controlled releases.
  • Tune pipeline and repository performance to support availability, execution-success, data-currency, and response-time objectives.

Required Qualifications

  • 8+ years of relevant professional experience.
  • Bachelor’s degree in computer science, Data Engineering, Information Systems, Engineering, or a related field.
  • Advanced hands-on proficiency with SQL, Python, Azure Databricks, and Azure data engineering services.
  • Experience with ETL/ELT orchestration, APIs, data-quality controls, monitoring, troubleshooting, and performance tuning.
  • Experience using Git and CI/CD practices to test and promote data-engineering code.
  • Ability to document complex data flows, mappings, dependencies, and operating procedures.
  • Must satisfy applicable DoD/DAF security, cybersecurity-awareness, CUI, OPSEC, and access-training requirements.

Preferred Qualifications

  • Microsoft Azure or Databricks certification.
  • Experience integrating DoD or DAF source systems.
  • Familiarity with defense HR, financial, logistics, readiness, or maintenance data.

Why Join Nationwide IT Services?

Nationwide IT Services is a trusted government contractor supporting Department of Defense customers. This role supports the Air National Guard Chief Data and Artificial Intelligence Office (CDAO), helping sustain and advance enterprise data, business intelligence, application, and AI capabilities that enable faster, data-driven mission decisions.

Our benefits package includes medical, dental, and vision insurance, life and disability insurance, a 401(k) plan with employer match, paid holidays, PTO (sick/vacation), commuter benefits, employee assistance program (EAP), educational reimbursement, and pet insurance.

Salary range $150,000 to $188,000 annually  The salary range is a general guideline. We consider several factors when determining base salary offers, including the position's scope and responsibilities, the candidate's experience, education, and skills, and current market conditions.

Similar roles