Senior Data Engineer
Tastewise Tel Aviv, Tel-Aviv District, Israel
Technology, Information and Internet · 51-200 employees
About the role
You will own the end-to-end architecture and delivery of web-scale data ingestion pipelines, including resilient scraping and transformation. Additionally, you will design distributed cloud-based systems and ensure data quality while leveraging AI tools to optimize development cycles.
What they look for
Requirements
Candidates must have 5+ years of experience in Data Engineering or Backend roles with expert-level web scraping skills. Proficiency in Airflow, Databricks, distributed systems, and AI-assisted development is required.
Full description
Passionate about food and curious about what drives consumer choices? Join Tastewise and help shape the future of the food and beverage industry.
Tastewise is a human-and-agent food intelligence and marketing platform used by leading companies like PepsiCo, Nestlé, and Kraft Heinz to decide what products to launch, how to market them, and what ultimately makes it to the shelf.
We turn real consumer behavior into actionable insights, helping teams make smarter, faster decisions in a $10 trillion industry that impacts billions of people every day.
If you’re excited about turning data into real-world impact and being part of a collaborative team with a clear mission, this is the place for you!
About the role
As a Senior Data Engineer in our R&D team, you aren't just moving bytes; you are the architect of the world's most comprehensive food-intelligence engine. You will take full ownership of our ingestion pipelines, transforming massive volumes of unstructured web data into the actionable insights our customers rely on. This role requires a builder who can navigate complex anti-bot measures, design resilient distributed systems, and ensure our data remains flawless as we scale.
Key responsibilities:
- Own end-to-end architecture and delivery of our web-scale data ingestion pipelines, from resilient scraping through transformation and storage.
- Design and maintain scrapers that reliably bypass anti-bot measures and handle dynamic content at scale, adapting quickly as sources change.
- Leverage AI coding assistants (Claude Code, Codex) to accelerate development, optimize pipeline logic, and ship faster within titling R&D cycles.
- Build and manage distributed, cloud-based data pipelines that support real-time analytics and AI model deployment.
- Proactively identify and resolve data quality issues before they reach production, ensuring accuracy and consistency across all sources.
- Architect scalable API and system designs that connect pipeline decisions directly to business value and consumer-trend accuracy.
- Monitor, troubleshoot, and continuously improve data workflows to keep the engine reliable as we scale.
Requirements
- 5+ years of experience in Data Engineering or Backend roles focused on high-volume data processing.
- Experience with Airflow & Databricks
- Expert-level web scraping skills: proven ability to build resilient scrapers that bypass anti-bot measures and handle dynamic content at scale.
- Extreme ownership: a track record of managing pipelines end-to-end and proactively fixing quality issues before they reach production.
- High AI-literacy: active use of LLMs and AI coding assistants (Claude Code, Codex) to accelerate development and optimize logic.
- Strong technical depth in distributed systems, cloud architecture, and low-latency data modeling.
- Data literacy: the ability to connect technical pipeline decisions to business value and consumer trend accuracy..
- Experience with System Design Thinking and building scalable API architectures.
**Please note that this position is 4 days/week in our Tel-Aviv office**
Similar roles
-
Data Engineer
Green River Data Analysis Vermont, United States · $120K–$135K/yr
-
Data Engineer Mid
Bluetab, an IBM Company San Isidro, Lima, Peru
-
Senior Data Engineer, Blockchain data and/or NLP pipelines
Inca Digital, Inc. United States
-
Data Engineer Jr
Bluetab, an IBM Company Bogota, Capital District, RAP (Especial) Central, Colombia
-
Senior Data Engineer
Sporty Group São José da Laje, Alagoas, Brazil
-
Senior Software Engineer (Data Engineer)
NielsenIQ Chennai, Tamil Nadu, India