JobCubby JobCubby
Sign up
Datamatics Technologies

Senior Data Engineer / Data Pipeline Architect

Datamatics Technologies Bengaluru, Karnataka, India

IT Services and IT Consulting · 51-200 employees

3 d ago
data-engineer Senior (5-10 yrs) Full-time India
Create a free account to apply — email only, no card. You can also save this posting or score it against your profile with AI.

Applying here? Try the free cover letter tool — paste this posting and your résumé, no account needed.

About the role

Design and lead the technical migration of data pipelines to meet strict security, encryption, and data retention requirements. Establish sustainable engineering processes while mentoring team members to ensure long-term pipeline reliability and maintenance.

What they look for

Airflow Spark Dbt BigQuery Python Data Pipeline Architecture Data Migration Encryption Data Retention Data Deletion Technical Leadership Mentoring Incident Management Code Reviews Testing GCP

Requirements

Requires 5 to 10 years of professional experience with deep hands-on expertise in Airflow, Spark, dbt, BigQuery, and Python. Candidates must have a proven track record of leading complete data pipeline migrations and implementing robust engineering standards.

Full description

Senior Data Engineer / Data Pipeline Architect

Location: Stockholm, Sweden (Hybrid – Travel Required) Experience Required: 5 to 10 years Duration: 6 months (Extendable) Employment Type: FTE Working Mode: Hybrid (Travel Required) Language: English Start: November 9, 2026 – April 30, 2027

We are looking for an experienced Senior Data Engineer / Data Pipeline Architect for an assignment in Stockholm focusing on data pipeline modernization, data security, and technical architecture.

The assignment involves leading the technical migration of existing data pipelines to meet stricter requirements for encryption, data retention, and deletion of user data, including historical and derived datasets.

Key Responsibilities

  • Design and drive the architecture, migrating pipelines incrementally while ensuring existing outputs remain unchanged.
  • Establish sustainable engineering processes for testing, code reviews, incident management, and releases.
  • Combine architectural leadership with hands-on engineering using Airflow, Spark, dbt, BigQuery, and Python.
  • Collaborate closely with and mentor a Data Engineer within the team, ensuring long-term ownership, reliability, and independent maintenance of the migrated pipelines.

Must-Have Requirements

  • Minimum 5 years of relevant professional experience (5–10 years overall).
  • Deep hands-on experience with Airflow, Spark, dbt, BigQuery, and Python.
  • Proven experience technically leading at least one complete data pipeline migration from start to finish.
  • Experience refactoring production data pipelines while verifying that their outputs remain unchanged.
  • Experience establishing and implementing engineering processes for testing, code reviews, and incident management.
  • Demonstrated mentoring experience with measurable outcomes.

Education

  • Minimum Bachelor's degree (or equivalent).

Nice-to-Have

  • Experience with encryption at rest, data retention, or data deletion compliance (e.g., GDPR).
  • Experience with envelope encryption and key management solutions (e.g., GCP KMS, AEAD functions, or Tink).
  • Knowledge of BigQuery column-level security, policy tags, and Data Catalog.
  • Experience with Config Connector (KCC) for managing GCP resources through Kubernetes.
  • Experience with event-driven architectures using Kafka.

Similar roles