Data Analytics Engineer
GIGATEC Engineering · Columbia, Maryland, United States
About the role
You will design and maintain reliable Apache Airflow pipelines to orchestrate complex data workflows. This role involves building workflow engines to ensure data is processed efficiently for analytics and operational requirements.
What they look for
Requirements
Candidates must have recent software development experience in Python and Java, along with proficiency in Linux, Bash, and Big Data processing engines. A Top Secret clearance and successful polygraph completion are mandatory requirements for this position.
Benefits
Full description
Perks and Benefits
- 100% Paid Healthcare
- 10% 401k in every paycheck
- 100% Fully Vested!
NOTE – Our positions require a Top Secret clearance, as well as the favorable completion of a polygraph. Applicants must be authorized to work in the U.S. We are unable to sponsor an employment Visa.
What You’ll Be Doing (We don’t love the bullet points, but we love the work!)
In this key Data Engineering role, you'll get to build the workflow engines behind the curtain, designing reliable Apache Airflow pipelines that keep data moving cleanly, efficiently, and on schedule for analytics and operational needs.Required Skills
- Experience using the Linux CLI and Linux tools
- Experience developing Bash scripts to automate manual processes
- Recent software development experience using Python and Java
- Experience using Apache Airflow (DAG design, scheduling, operators, sensors) to orchestrate, schedule, and monitor complex workflows
- Experience using Distributed Big Data processing engines including Apache Spark
- Experience with containerization technologies such as Docker, containerd, and Podman
- Experience with Git Source Control System
Desired Skills
- Experience using the Atlassian Tool Suite (JIRA, Confluence)
- Familiar with AWS Cloud Services and Infrastructure
- Appreciates a sense of humor and the occasional well-timed joke. 😄
