Cloud Data Engineer

Position: Cloud Data Engineer

Location: Toronto, ON

Job ID#: RQ11576

Duration: 12 Months

Role Overview

We are seeking an experienced Cloud Data Engineer to support the design, development, implementation, and optimization of modern cloud-based data platforms and services. The successful candidate will contribute to enterprise data initiatives, including data pipeline development, cloud modernization, metadata management, governance integration, and DataOps automation.

Key Responsibilities

• Design

and develop data pipelines from source systems through to end-user consumption.

• Optimize

and enhance data pipeline performance and reliability.

• Develop

scalable ETL/ELT processes, data pipelines, and integration solutions.

• Implement

DataOps practices, including deployment automation, testing, monitoring, and operational support.

• Design

and support cloud-native data engineering solutions and modern data platform architectures.

• Implement

metadata, lineage, and data quality capabilities within cloud data environments.

• Develop

integration solutions using APIs, event-driven architectures, batch processing, and streaming technologies.

• Automate

metadata collection, data movement, and operational processes.

• Support

cloud modernization and enterprise data migration initiatives.

• Collaborate

with architects, data modelers, and governance teams to operationalize data standards, metadata, and common data models.

• Troubleshoot

complex technical issues and develop practical solutions.

• Support

performance optimization and scalability initiatives for cloud data platforms.

Qualifications

General Skills

• Demonstrated

experience designing, implementing, and supporting cloud-based data platforms and services.

• Experience

with cloud data platforms, data management, and data exchange technologies.

• Experience

with commercial and open-source database development and management technologies.

• Experience

managing Data as a Service (DaaS), Database as a Service (DBaaS), Data Warehouse as a Service (DWaaS), and related storage platforms.

• Experience

with data pipeline and workflow development, orchestration, deployment, and automation.

• Strong

programming skills with the ability to integrate multiple platforms and automate tasks.

• Experience

implementing DataOps principles, best practices, and Agile delivery methodologies.

• Experience

with CI/CD processes and data provisioning automation.

• Experience

supporting digital products, data analysis, data exchange, data provisioning, and data security.

• Extensive

experience designing, developing, and implementing data migration and conversion solutions involving very large datasets.

• Experience

working with OLAP and OLTP environments.

• Experience

supporting cloud SaaS, PaaS, and IaaS environments.

• Experience

designing data warehouses, data lakes, data lakehouses, fact/dimension models, and data mappings.

• Experience

managing cloud data services including storage, repositories, key vaults, virtual machines, and related infrastructure.

• Experience

with structured, semi-structured, and unstructured data ingestion and provisioning solutions.

• Experience

with performance monitoring and tuning of DataOps environments.

• Excellent

analytical, communication, presentation, problem-solving, and stakeholder engagement skills.

• Proven

ability to deliver work within deadlines and contribute effectively in team environments.

Deliverables

The selected candidate will contribute to:

• Data

pipelines and integration services

• Automated

metadata collection and synchronization processes

• Cloud

data platform implementation and configuration

• Data

quality and lineage enablement

• CI/CD

and DataOps automation

• Data

migration and interoperability services

• Cloud-hosted

data products and reusable data services

• Metadata

and governance platform integrations

Preferred Skills

• Experience

with Databricks, Delta Lake, and Databricks SQL.

• Knowledge

of Medallion Architecture.

• Experience

with Microsoft Fabric and Azure Data Services.

• Experience

with Microsoft Purview.

• Experience

with Informatica or equivalent integration platforms.

• Experience

operationalizing common data models and metadata repositories.

• Experience

with graph technologies and semantic repositories.

• Knowledge

of AODA and accessibility-related standards.

• Ability

to adapt quickly to changing priorities and tight deadlines.

• Previous

public sector experience is considered an asset.

Work Arrangement

• 5

days onsite

About Symbiotic Digital.

Symbiotic Digital provides the IT Experts you need that solve problems and get things done. See what the top 2% in their field can do for you. (Symbiotic Digital is a division of Symbiotic Group Inc.) We serve customers in two ways, we provide:

• Digital

Experts: IT Consulting expertise. Bright Minds That Produce Proven Results

• Recruitment:

Find The Right People You Need

Serving IT & Business leaders, Symbiotic Digital provides a business system that enable us to provide the Expert Technical staff needed to solve challenging business and IT problems. IT leaders in the most reputable organizations in Canada have relied on Symbiotic Digital to help them staff difficult assignments with proven Experts uniquely evaluated by our proven QMS- Quality Management System Staff Development Model. We are a 100% Indigenous owned company.

Learn more online at https://www.symbioticgroup.com/home-sd/.

Please submit your most recent resume to: RecDep@symbioticgroup.com

View All Jobs online at: https://www.symbioticgroup.com/view-jobs/