JobCubby JobCubby
Sign up
E

Databricks Data Engineer

Elevate Government Solutions Washington, District of Columbia, United States

IT Services and IT Consulting · 11-50 employees

7 h ago
Remote data-engineer Senior (5-10 yrs) Full-time United States
Create a free account to apply — email only, no card. You can also save this posting or score it against your profile with AI.

About the role

Design, build, and maintain scalable batch and streaming data pipelines using PySpark and Databricks. Implement data quality frameworks, optimize Spark performance, and manage data lineage for federal client systems.

What they look for

Databricks PySpark SQL Data Engineering Python Git CI/CD Data Modeling Data Architecture Unity Catalog DLT Workflows Kafka Kinesis Auto Loader Medallion Architecture

Requirements

Requires 5+ years of data engineering experience with at least 2 years specifically in Databricks. Candidates must possess an active Secret security clearance and be US citizens residing in the United States.

Benefits

Health Insurance 401k match Unlimited Vacation 11 Federal Holidays Remote work Training Mentoring/Coaching

Full description

This position requires an ACTIVE SECRET security clearance. Your application will not be reviewed if you do not have an ACTIVE security clearance at SECRET or above.

Elevate Government Solutions is a high growth Technology Services company focused on driving technological change in the government space. Our teams engage with various government agencies to develop and deploy emerging technology solutions using a tailored Agile methodology.

We are seeking a highly motivated and intellectually curious Databricks Platform Engineer/Admin to join our team working with a Federal client. The position will be a remote role open to US citizens residing in the United States with a Secret security clearance.

Responsibilities and Duties

  • Design, build, and maintain batch and streaming pipelines using PySpark, SQL, Databricks Workflows/DLT
  • Implement Medallion architecture (bronze/silver/gold) for data curation and quality
  • Build ingestion frameworks for structured/semi-structured/unstructured data from files, databases, APIs, and streaming sources (Kafka, Kinesis, Auto Loader)
  • Design data models (dimensional or domain-specific) supporting downstream analytics
  • Build and consume APIs for data integration with downstream systems
  • Optimize Spark jobs for performance and cost (partitioning, caching, cluster sizing)
  • Implement data quality checks and pipeline monitoring
  • Document data flows and lineage for maintainability

Required Experience, Skills and Qualifications

  • 5+ years data engineering experience, 2+ years on Databricks
  • Strong PySpark and SQL for production-grade transformations
  • Experience with both batch and streaming data processing
  • Solid grounding in data modeling and data architecture principles
  • Python proficiency and Git-based CI/CD workflow experience
  • Familiarity with Unity Catalog (catalogs, schemas, grants) from a consumer perspective
  • Experience with DLT or Workflows orchestration a plus

Education Requirement

  • 4 year Bachelor's Degree in Computer Science/Eng or related (highly preferred)

Benefits

  • Health Insurance
  • 401k match
  • Unlimited Vacation
  • 11 Federal Holidays
  • Remote work
  • Training
  • Mentoring/Coaching

Similar roles