Data Engineer
Vivid Tel-Aviv, Tel-Aviv District, Israel
Software Development · 11-50 employees
Applying here? Try the free cover letter tool — paste this posting and your résumé, no account needed.
About the role
Design and build scalable data pipelines to transform raw cloud and Kubernetes telemetry into service-level dependency maps. Manage the end-to-end production lifecycle, including reliability, monitoring, data quality, and cost optimization.
What they look for
Requirements
Requires 4+ years of experience in data engineering with expertise in large-scale log or telemetry data processing. Proficiency in SQL, cloud-native environments, and experience with tools like Athena, BigQuery, or Spark is essential.
Full description
Why COMO
COMO is building the future of cyber resilience. Our AI-native platform helps organizations understand their ability to recover from cyberattacks, identify critical gaps and dependencies, and prepare for what happens after an attack. Backed by a significant seed round led by General Catalyst, with a live product and paying customers, we're building an exceptional team to define a new category in cybersecurity.
About the Role
We're looking for a Data Engineer to build and own COMO's data pipelines: the pipelines that turn raw cloud and Kubernetes telemetry into the dependency map at the heart of the product, the answer to "what does this system depend on, and will it come back after an attack?" This is hands-on pipeline engineering over infrastructure telemetry at real enterprise scale, where a careless query isn't slow, it's expensive, and where the data is often wrong by design. You'll design, build, and run these pipelines end to end, alongside the engineers behind our collectors and graph engine.
What You'll Do
- Design and build the data pipelines that turn flow logs, cloud configuration, and Kubernetes data into service-level dependencies with confidence scores
- Own these pipelines in production: reliability, monitoring, data quality, and cost
- Make attribution provable: handle recycled identities, late and out-of-order data, and the places where cloud telemetry misattributes traffic
- Engineer for cost: partitioning, incremental processing, and sampling that keep a scan-heavy workload inside a budget
- Work closely with the engineers behind our Kubernetes collectors and graph engine, using AI tooling throughout the development lifecycle
What We're Looking For
- 4+ years of experience in a Data Engineering role, building and running data pipelines over large-scale log, event, or telemetry data
- Experience building pipelines over raw cloud or network telemetry at scale (VPC Flow Logs, CloudTrail, NetFlow, or similar) with Athena, BigQuery, Spark, ClickHouse, or equivalent
- Deep SQL: window functions, temporal joins, partitioning, and scan-cost control
- Cloud-native production experience (AWS or Azure)
- Experience owning a data pipeline end to end: design, production, operation, and cost
- Kubernetes familiarity (Pods, Services, networking) - advantage
- Security, observability, or network-analytics data background - advantage
Our Stack
Python, Polars, Athena / SQL over S3, Kafka, PostgreSQL, AWS and Azure APIs, Kubernetes, with an AI-native workflow throughout.
Similar roles
-
Data Engineer
TAL Sydney, New South Wales, Australia
-
Staff Data Engineer
Meeru AI Inc Pleasanton, California, United States
-
Platform & Data Engineer
Apple Cupertino, California, United States
-
Senior Data Engineer
Bitful Consulting Wadsworth, Ohio, United States
-
Senior Data Engineer
Xometry Waltham, Massachusetts, United States · $119K–$155K/yr
- Forward Deployed Data Engineer