Data Engineer
Bigbear.ai McLean, Virginia, United States
Software Development · 501-1,000 employees
About the role
Build and maintain source adapters and normalization logic to transform raw data from disparate systems into a consistent risk-signal schema. Implement robust ETL/ELT pipelines with a focus on observability, data quality, and near-real-time event streaming.
What they look for
Requirements
Requires an active Top Secret security clearance and 3+ years of experience in data engineering with production-grade pipelines. Candidates should possess strong skills in API integrations, SQL, and Python or Java, along with a Bachelor's degree or equivalent experience.
Full description
Residency
All applicants must currently reside in the United States
Overview
BigBear.ai is hiring Data Engineers to build and maintain the source adapters and normalization logic that translate raw data from disparate systems into a common risk-signal schema. This position focuses on reliable ingestion and transformation—turning heterogeneous legacy inputs (APIs, feeds, databases, files, and event streams) into consistent, high-quality signals that downstream scoring and adjudication workflows can trust.
This position is remote but will require travel in the DMV area.
What you will do
- Build source adapters/connectors to ingest data from APIs, legacy systems, databases, and event streams
- Develop normalization and mapping logic to translate source-specific fields into the common risk-signal schema (including validation, enrichment, and standardization)
- Implement ETL/ELT pipelines with strong engineering rigor: testing, observability, error handling, retries, and backfills
- Produce and consume streaming events (e.g., Kafka topics) to support near-real-time signal delivery and downstream processing
- Partner with data architecture and domain SMEs to define and maintain data contracts, mappings, and lineage from source to normalized signal
- Ensure data quality and consistency (deduplication patterns, schema evolution handling, and reconciliation against source systems)
- Optimize pipeline performance and reliability (throughput, latency, and scalable processing patterns)
- Create and maintain technical documentation for adapters, transformations, and operational runbooks
- Some travel may be required within the DMV area
What you need to have
- Clearance: Must maintain an active Top Secret security clearance
- Bachelor's Degree and 5 to 8 years of experience with a Bachelor's degree, equivalent experience may be accepted in lieu of a degree
- 3+ years of experience in data engineering, including building production-grade ingestion and transformation pipelines.
- Strong experience with API integrations and ETL/ELT development in complex environments.
- Experience integrating heterogeneous and/or legacy systems with inconsistent schemas and data quality.
- Experience with REST/API frameworks and building maintainable, well-tested integration services.
What we'd like you to have
- Engineering discipline: writes maintainable, testable code and builds robust pipelines that handle edge cases.
- Curiosity and persistence: digs into messy source data and drives it to consistent outcomes.
- Collaboration: works effectively across data architecture, scoring/analytics, and application teams.
- Operational mindset: builds pipelines that are observable, debuggable, and supportable in production.
- Solid SQL skills and working familiarity with NoSQL data stores.
- Proficiency in Python or Java for building data services and transformation logic.
- Hands-on experience producing/consuming events in Kafka (producers/consumers) or an equivalent event streaming platform
Tools & Technical Skills
- AWS Certification – Data Engineer
- Graph Database experience
- SQL and NoSQL databases
- AWS DMS (Database Migration Service)
Pay transparency
Please note the targeted compensation range is provided as an estimate, and any actual compensation offer may vary depending on the needs of the company, or an applicant's skillset, competencies, experience, education, certifications, location, or other factors. The estimated range does not include the value of any benefits offered.
About BigBear.ai
BigBear.ai is a leading provider of AI-powered decision intelligence solutions for national security, supply chain management, and digital identity. Customers and partners rely on Bigbear.ai’s predictive analytics capabilities in highly complex, distributed, mission-based operating environments. Headquartered in McLean, Virginia, BigBear.ai is a public company traded on the NYSE under the symbol BBAI. For more information, visit https://bigbear.ai/ and follow BigBear.ai on LinkedIn: @BigBear.ai and X: @BigBearai.
BigBear.ai is an Equal opportunity employer all protected groups, including protected veterans and individuals with disabilities.
Similar roles
-
Senior BI and Data Engineer (Sydney)
Trideca Sydney, New South Wales, Australia
-
M26 - Data Engineer
FPT Asia Pacific Pte Ltd Singapore, Singapore
-
Data Engineer
Tower Research Capital Hong Kong, Hong Kong Island, Hong Kong S.A.R.
-
Principal Data Engineer
UnitedHealth Group Gurgaon, Haryana, India
-
AWS Data Engineer
ON.energy Ciudad de México, Mexico
-
Data Engineer
Veralto Global Bangalore North, Karnataka, India