Senior Data Engineer Backend
Flagler Health Vancouver, British Columbia, Canada
Technology, Information and Internet · 11-50 employees
About the role
The Senior Data Engineer will develop, manage, and optimize data pipelines on the Databricks platform while writing clean, efficient Python code. They will also integrate and manage MongoDB databases and collaborate with data scientists to solve complex data processing challenges.
What they look for
Requirements
Candidates must have proven experience with Databricks, Spark, and Python, along with proficiency in NoSQL databases like MongoDB. Strong problem-solving skills and experience with large-scale data processing and distributed systems are required.
Full description
Flagler Health is building the clinical operating system for modern musculoskeletal care.
We partner with MSK provider groups and specialty clinics to help them grow, operate more efficiently, and deliver better longitudinal care across patient acquisition, clinical workflows, and ongoing patient engagement. Our platform sits at the intersection of care delivery and clinic operations, helping providers capture more value across the full patient lifecycle.
We’ve recently raised our Series B and are entering our next phase of growth.
Key Responsibilities
Databricks Platform Expertise
- Develop, manage, and optimize data pipelines on the Databricks platform.
- Debug and troubleshoot Spark applications to ensure reliability and performance.
- Implement best practices for Spark compute and optimize workloads.
- Python Development:
- Write clean, efficient, and reusable Python code using object-oriented programming principles.
- Design and build APIs to support data integration and application needs.
- Develop scripts and tools to automate data processing and workflows.
MongoDB Management
- Integrate, query, and manage data within MongoDB.
- Ensure efficient storage and retrieval processes tailored to application requirements.
- Optimize MongoDB performance for large-scale data handling.
- Collaboration and Problem Solving:
- Work closely with data scientists, analysts, and other stakeholders to understand data needs and deliver solutions.
- Proactively identify and address technical challenges related to data processing and system design.
Required Qualifications
- Proven experience working with Databricks and Spark compute.
- Proficient in Python, including object-oriented programming and API development.
- Familiarity with NoSQL (MongoDB preferred), including querying, data modeling, and optimization.
- Strong problem-solving skills and ability to debug and optimize data processing tasks.
- Experience with large-scale data processing and distributed systems.
Preferred Qualifications
- Strong understanding of data architecture, ETL processes, and data warehousing concepts.
- Knowledge of other big data technologies like Delta Lake, Hadoop, or Kafka.
- Experience with cloud platforms (e.g., AWS, Azure, or GCP).
- Familiarity with CI/CD pipelines and version control systems like Git.
Our Values:
This is what you can expect of your teammates at Flagler:
- Owner: We own our work like founders. We don't wait to be asked, and we pick up the problem nobody else has.
- Builder: We like making things from scratch. We don't need a playbook to start, and we'd rather ship a rough first version than wait on a perfect spec.
- Fast: We make quick decisions. We favor progress and respect process.
- Transparent: We communicate directly. We value merit and honesty, and we challenge assumptions, including our own.
- Curious: We explore new approaches and ask "why" often.
Similar roles
-
Data Engineer Data Conversions
Enroute Peru
-
Associate Data Engineer
Infoblox Tacoma, Washington, United States · $82K–$117K/yr
-
[8AD] Data Engineer
Software Mind San José, Costa Rica
-
Data Engineer
LLR Partners Philadelphia, Pennsylvania, United States
-
Senior Data Engineer
phData Jyväskylä, Central Finland, Finland
-
Data Engineer
GRVTY Sterling, Virginia, United States · $100K–$186K/yr