JobCubby JobCubby
Sign up
Aurora Engineering AB

Senior Data Engineer – Azure

Aurora Engineering AB Gothenburg, Sweden

IT Services and IT Consulting · 11-50 employees

7 h ago
data-engineer Senior (5-10 yrs) Full-time Sweden
Create a free account to apply — email only, no card. You can also save this posting or score it against your profile with AI.

About the role

Design, build, and maintain scalable batch and streaming data pipelines within the Microsoft Azure ecosystem. Integrate AI/ML models with applications and enterprise systems while ensuring high data quality and production reliability.

What they look for

Azure Data Engineering Python PySpark Azure Data Factory Azure Databricks Delta Lake CI/CD Azure DevOps Streaming Architectures Batch Processing API Integration Event-driven Architecture Kafka Azure Service Bus Data Modeling

Requirements

Requires at least 5 years of professional data engineering experience with strong proficiency in Python, PySpark, and Azure technologies. Candidates must possess advanced skills in data modeling, CI/CD implementation, and system integration.

Full description

We are looking for an experienced Senior Data Engineer with strong hands-on expertise in building scalable, reliable, and production-ready data solutions within the Microsoft Azure ecosystem.

The ideal candidate combines strong data engineering capabilities with experience in system/API integration, streaming architectures, CI/CD, and AI model integration.

Key Responsibilities

  • Design, build, and maintain scalable data pipelines in Microsoft Azure
  • Develop ETL/ELT solutions using Azure Data Factory, Azure Databricks, and Blob Storage
  • Transform and process large structured and unstructured datasets using Python and PySpark
  • Build and maintain both batch and streaming data pipelines
  • Work with event-driven architectures using technologies such as Azure Service Bus, Kafka, or equivalent
  • Design and optimize data models in Azure Databricks and Delta Lake
  • Improve pipeline performance through partitioning, optimization, and performance tuning
  • Implement and maintain CI/CD pipelines using Azure DevOps
  • Ensure data quality, monitoring, reliability, and stability in production environments
  • Develop and maintain API and enterprise system integrations
  • Integrate AI/ML models with applications, APIs, data pipelines, and production systems

Required Qualifications

  • 5+ years of relevant Data Engineering experience
  • Strong hands-on experience with Microsoft Azure
  • Advanced proficiency in Python and PySpark
  • Strong experience with Azure Data Factory and Azure Databricks
  • Experience with Delta Lake, data modeling, partitioning, and performance optimization
  • Experience with both streaming and batch processing
  • Knowledge of Kafka, Azure Service Bus, or similar event-driven technologies
  • Strong experience with Azure DevOps and CI/CD
  • Experience with API integration and system integration
  • Understanding of production-level data quality, monitoring, and reliability
  • Experience connecting AI/ML models to production systems
  • Strong analytical, troubleshooting, and problem-solving skills

⚠️ Important: Candidates must currently be located in Gothenburg, Sweden.

Similar roles