Sr Devops Engineer

ROLE OVERVIEW

We are seeking an experienced DevOps Engineer with strong data platform and SRE expertise to drive the design, implementation, and operational excellence of a modern client Data Platform. In this high-impact position, you will bridge the gap between infrastructure automation and modern data architecture. You will lead technical initiatives covering automated provisioning on Microsoft Azure, orchestrating scalable enterprise data workflows via Astronomer and dbt, and establishing robust continuous integration/continuous delivery (CI/CD) practices for all data engineering workloads.

PRIMARY RESPONSIBILITIES

Infrastructure as Code: Design, implement, and deploy ARM templates for automated Azure infrastructure provisioning and environment lifecycle management.

Azure Service Provisioning: Configure and maintain scalable Azure services, including Azure Functions, Event Bus, and Event Grid for event-driven data flows.

Snowflake Architecture & Security: Create and manage enterprise Snowflake accounts. Maintain role-based access control (RBAC), virtual warehouses, security policies, and performance tuning.

Workflow Orchestration: Deploy, configure, and operate Astronomer (Apache Airflow) for production-grade orchestration and scheduling of data pipelines.

dbt Pipeline Automation: Automate deployment pipelines for dbt projects, ensuring strict code quality standards, modularity, test coverage, and continuous delivery.

Secrets & Security Governance: Centralize and secure credential management using Azure Key Vault (AKV) for safe DevOps automation and runtime access across environments.

Secure File Transport: Architect and set up SFTP ingestion workflows utilizing a Bastion Host, ensuring secure landing into Azure Blob Storage containers.

CI/CD Engineering: Build, maintain, and optimize robust CI/CD deployment pipelines (e.g., Azure Repos / Pipelines) tailored for data engineering workloads.

Platform Observability: Monitor overall system health, data pipeline reliability, and platform performance using enterprise observability tooling (e.g., Prometheus, Grafana).

Integration Management: Establish seamlessly integrated ecosystems connecting Snowflake with upstream and downstream systems, specifically dbt and Astronomer.

Architectural Collaboration: Partner closely with Data Engineers, Data Architects, and enterprise stakeholders to define infrastructure deployment standards, operational SLAs, and reliability targets.

Technical Documentation: Author and maintain comprehensive technical documentation covering infrastructure designs, CI/CD procedures, runbooks, and DevOps best practices.

Requirements

• 8+ years in a DevOps, SRE, or Data Infrastructure

role within a data-centric enterprise environment.

• Azure Expertise: Strong practical experience with

ARM templates, Azure Resource Manager, Azure Functions, Event Bus, and Event Grid.

• Airflow / Astronomer: Hands-on experience

deploying and operating Astronomer or Apache Airflow in production.

• Data CI/CD: Proven track record building CI/CD

pipelines specifically for data workloads (dbt, Airflow, schema migrations).

• Snowflake Mastery: Deep understanding of

Snowflake RBAC, performance tuning, warehouse management, and ecosystem integrations.

• Containerization: Solid hands-on experience with

Docker and managing containerized services in production environments.

• Secrets Security: Demonstrated experience

managing secrets, keys, and certificates securely via Azure Key Vault (AKV).

• Data Ingestion Architecture: Practical exposure

to secure SFTP-to-Blob integrations using Bastion host routing.

• Observability: Proficiency with monitoring and

alerting tools such as Prometheus, Grafana, or cloud-native telemetry.

Nice to Have

• Exposure to dbt Cloud or advanced dbt Core

deployment patterns.

• Familiarity with GitOps workflows and declarative

infrastructure tools.

• Experience working in agile, cross-functional

engineering teams.

• In-depth understanding of enterprise data

governance and security frameworks.