Senior Data Engineer
73 Strings London, England, United Kingdom
Financial Services · 201-500 employees
Applying here? Try the free cover letter tool — paste this posting and your résumé, no account needed.
About the role
You will own and operate production data pipelines from source capture through transformation and client delivery. This role involves redefining platform architecture to ensure stability and security while collaborating with product and valuation teams.
What they look for
Requirements
Candidates must have over 10 years of experience in data engineering on production systems with expertise in Snowflake or Databricks. Proficiency in Python, SQL, and CI/CD workflows is essential for building and maintaining scalable data platforms.
Full description
OVERVIEW OF 73 STRINGS:
73 Strings is an innovative platform providing comprehensive data extraction, monitoring, and valuation solutions for the private capital industry. The company's AI-powered platform streamlines middle-office processes for alternative investments, enabling seamless data structuring and standardization, monitoring, and fair value estimation at the click of a button. 73 Strings serves clients globally across various strategies, including Private Equity, Growth Equity, Venture Capital, Infrastructure and Private Credit.
Our 2025 $55M Series B, the largest in the industry, was led by Goldman Sachs, with participation from Golub Capital and Hamilton Lane, with continued support from Blackstone, Fidelity International Strategic Ventures and Broadhaven Ventures.
About the role
We are hiring a Senior Data Engineer to build and operate the pipelines, integrations and warehouse that support valuation and monitoring.
You will own production pipelines from source capture through transformation, reconciliation and client delivery, and put them under GitHub, automated test and CI/CD. The platform currently captures change data from relational systems, processes it on Azure Databricks, and delivers it to Snowflake, Microsoft SQL Server and Databricks. The capture method may change. Copied client pipelines are being replaced by metadata-driven components, with data contracts, quality rules and lineage.
What you will do
- Help redefine the platform’s architecture across ingestion, processing and delivery, so it’s stable, secure and fast enough to support advanced use cases for the business.
- Build and operate batch and streaming pipelines from databases, APIs, event streams and semi-structured sources.
- Implement change data capture and incremental load, including ordering, deletes, replay and slowly changing dimensions.
- Build medallion datasets and dimensional models, and deliver them to Snowflake, Microsoft SQL Server and Databricks.
- Apply data contracts, reconciliation and row-level quarantine before publication.
- Own the GitHub workflow and CI/CD, including tests, review, environment promotion and deployment as code.
- Investigate production data failures, and turn requirements from product, valuation and client-facing teams into operable pipelines.
Requirements
- 10+ years in data engineering on production systems.
- Snowflake or Databricks as a primary platform, including modelling, performance tuning and cost management.
- Python and SQL for pipeline development and testing.
- Change data capture and event processing, including ordering, replay and schema change.
- Azure, including Databricks, ADLS and private network connectivity.
- GitHub and CI/CD for data workloads, using GitHub Actions or an equivalent system.
- Data quality, reconciliation, monitoring and production incident response.
- Experience building multi-tenant, secure data platforms, including tenant isolation, access control and data protection.
Desirable
- Databricks Lakeflow, Auto CDC, Declarative Automation Bundles and DQX, or the Snowflake equivalents: Dynamic Tables, Streams and Tasks, Snowpark, Snowflake CLI deployments and Data Metric Functions.
- Debezium, Kafka Connect or Confluent Kafka. This is the current ingestion path. It may be replaced.
- Apache Airflow, or an equivalent workflow orchestrator.
- Kafka or Spark Structured Streaming, Apache Iceberg or Delta Sharing, and dbt for analytical models on curated data.
- Private markets data: valuations, funds, portfolio companies or capital activity.
- Comfortable working directly with client technical teams, and collaborating across field engineering, product and other stakeholders.
Similar roles
-
Data Engineer (m/w/d) Microsoft Fabric - Erneuerbare Energien
maxsolar Feldkirchen, Bavaria, Germany
-
Data Engineer (Dataiku Expert)
Inetum Lisbon, Portugal
-
Data Engineer H/F
EVERIENCE Paris, Ile-de-France, France
-
Cloud AI Data Engineer II, Professional Services, Google Cloud
Google Boulder, Colorado, United States · $156K–$226K/yr
-
Junior Data Engineer
FINARTIX Fintech Solutions S.A. Athens, Attica, Greece
-
Junior Data Engineer
Angkas Makati, Metro Manila, Philippines