Data Engineer (Python, Airflow, Snowflake)
OPTIVEUM sp. z o.o. Auburn, Maine, United States · PLN 281K/yr
Outsourcing and Offshoring Consulting · 2-10 employees
Applying here? Try the free cover letter tool — paste this posting and your résumé, no account needed.
About the role
Migrate legacy ETL pipelines to a modern Airflow-on-Kubernetes orchestration platform while building reliable, scalable data ingestion pipelines. Collaborate with stakeholders to onboard financial data feeds and contribute to the evolution of CI/CD and data quality practices.
What they look for
Requirements
Requires strong hands-on experience with Python, Apache Airflow, and SQL, along with proven expertise in ETL development. Candidates should have a solid understanding of data modelling and experience working in large, cross-team environments.
Full description
Data Engineer (Python, Airflow, Snowflake)
We are currently looking for a Senior Data Engineer to join the team of our client, a major bank, working on a long-term, multi-year data platform programme. The platform integrates, processes and delivers large-scale financial data (credit risk, customer and regulatory data) that supports critical decision-making and reporting across the organisation. The programme is moving away from legacy ETL tooling towards a cloud-native stack built on Apache Airflow and Snowflake. It combines migrating existing solutions with building and maintaining the pipelines and platform of tomorrow, and offers room to grow into broader ownership over time. For this role, Optiveum is the recruitment and contracting party, which means you will sign the cooperation agreement directly with us.
Key Details:
- Rate: up to 135 PLN/h net + VAT (B2B)
- Work Model: hybrid – 3 days per week in the office
- Location: Gdańsk
- Key Skills: Python, Apache Airflow, SQL, ETL, Snowflake, Git, data modelling
Responsibilities:
- Migrating existing legacy ETL pipelines (100+ pipelines across dozens of source systems) to a modern Airflow-on-Kubernetes orchestration platform.
- Designing, building and maintaining new data ingestion pipelines that are reliable, observable and easy to operate at scale.
- Working closely with source-system teams and stakeholders across the bank to onboard new financial data feeds and keep existing ones healthy.
- Progressively getting involved in the Snowflake transformation layer, including the move towards dbt and Python-based data modelling.
- Contributing to CI/CD, testing and data-quality practices as tooling and processes evolve.
- Helping shape the technical direction as the platform and the team continue to grow.
Requirements:
- Strong hands-on experience with Python.
- Solid experience with Apache Airflow (or similar orchestration tools).
- Strong SQL skills.
- Proven experience in ETL / data pipeline development.
- Experience with Git and standard version-control workflows.
- Working knowledge of Snowflake (or another major cloud data warehouse).
- Understanding of data modelling fundamentals (dimensional modelling, partitioning, incremental load strategies, etc.).
- Comfortable working in a large, cross-team environment with multiple stakeholders and dependencies.
- Fluent English, spoken and written.
Nice to have:
- Experience with dbt (Data Build Tool).
- Comfortable using AI coding assistants (e.g. GitHub Copilot) to accelerate development, testing and documentation.
- Experience with financial/banking data (credit risk, regulatory reporting or similar).
- Exposure to Scala/Spark or Snowpark.
- Experience with Kafka or other streaming/messaging platforms.
- Familiarity with CI/CD tooling (e.g. Jenkins) and data-quality/testing frameworks.
- Prior experience with a legacy-to-modern ETL migration (e.g. DataStage or Informatica moving to Airflow/dbt-style stacks).
Similar roles
-
Ingénieur(e) en développement Python H/F
ALTEN Boulogne-Billancourt, Ile-de-France, France · €35K–€45K/yr
-
Python Full Stack Developer
Expansion International Group Limited United Kingdom
-
Senior Full Stack Engineer (React / Next.js & Python / Java)
Innovecs Town of Russia, New York, United States
- Python Developer-Developer Tooling
-
Data Analyst (Python, R, SQL, SAS) w/ Public Health Data Experience (Job 1531)
DLH Atlanta, Georgia, United States
-
Forward Deployed Engineer (Python, AI/ML, Generative AI)
Modus Create United States