Avenga

Senior Data Engineer

Avenga Sweden

IT Services and IT Consulting · 5,001-10,000 employees

6 d ago
Remote data-engineer Senior (5-10 yrs) Full-time Sweden
Create a free account to apply — email only, no card. You can also save this posting or score it against your profile with AI.

About the role

Design and develop the Enterprise Data Catalog application, including front-end and back-end components. Integrate the application with Unity Catalog APIs, Databricks services, and external systems while ensuring secure authentication and authorization.

What they look for

Databricks Python React Node.js Streamlit Unity Catalog OAuth Microsoft Entra ID SSO RBAC Databricks SQL Lakehouse Architecture REST APIs CI/CD Git Azure DevOps

Requirements

Requires 5+ years of experience as a Data Engineer with proficiency in Databricks and web development technologies like React and Python. Candidates must have experience with enterprise-scale application design, metadata services, and CI/CD practices.

Full description

Avenga is an international engineering firm helping businesses operate with AI at the core. With 6,000+ experts worldwide, we combine engineering expertise with AI-native thinking to turn ambitious ideas into real-world impact across industries, technologies, and markets.

At the core of the role

We are looking for a Senior Data Engineer with Databricks to join our team. Our client is one of the largest state-owned energy companies and a leading producer and supplier of electricity and heat in Europe.

As a Senior Data Engineer, you will take part in setting standards, establishing guidelines, and sharing best practices in order to ensure continuous learning and development.

Core skills you’ll bring

  • 5+ years of experience as a Data Engineer
  • Proficiency in Databricks Apps development experience using React, Node.js, Python, Streamlit or similar technologies
  • Experience integrating with Unity Catalog APIs and metadata services
  • Proven experience implementing OAuth, Microsoft Entra ID, SSO, RBAC and group-based authorisation
  • Experience designing enterprise-scale web applications supporting large user groups
  • Strong knowledge of Databricks SQL, Serverless SQL, Jobs, Lakehouse architecture and governance
  • Familiarity with integrating external systems through REST APIs
  • Experience with CI/CD, Git, and Azure DevOps or GitHub Actions
  • English – Upper-intermediate or higher

Nice-to-have

  • Experience with MCP / JSON-RPC integration patterns
  • Familiarity with Databricks Genie and Genie Ontology
  • Knowledge of Unity Gateway or comparable governed data-access patterns

The impact you'll create

  • Design and develop the Enterprise Data Catalog application, including front-end and back-end components
  • Integrate the application with Unity Catalog APIs, Databricks services, metadata sources and external systems
  • Implement secure authentication, SSO, role-based and group-based authorisation, and user-context data access
  • Design high-performing metadata search, caching and indexing for a large user base
  • Implement CI/CD, automated testing, audit logging, monitoring and application observability
  • Support deployment, security and architecture reviews, troubleshooting and performance optimisation
  • Produce maintainable code, configuration and technical documentation, and provide knowledge transfer

People are at the core of Avenga. We provide equal opportunities regardless of race, ethnicity, gender identity, sexual orientation, disability, age, religion, or any other characteristic. We are committed to a respectful environment where everyone can be themselves, share their ideas, and feel that they belong.

Similar roles