JobCubby JobCubby
Sign up
Perplexity

Member of Technical Staff (Product Data Scientist, Search Quality)

Perplexity Berlin, Germany

Software Development · 201-500 employees

Aug 05
data-scientist Mid (2-5 yrs) Full-time Germany
Log in to apply, save this posting, or score it against your profile with AI.

About the role

You will develop data-driven insights from user behavior to inform the product roadmap and design experiments to improve search ranking quality. This involves building data pipelines, constructing labeling systems with human and LLM feedback, and tracking key performance metrics.

What they look for

Python SQL A/B Testing Data Analysis Statistics Apache Spark Databricks LLM-as-a-judge Business Intelligence Data Labeling Search Quality Product Roadmap Metric Design Data Visualization

Requirements

Candidates must have 4+ years of experience in data analysis or a related role with a strong background in search products and A/B testing. Proficiency in Python, SQL, and statistical analysis is required, with experience in Apache Spark and Databricks considered a plus.

Full description

Perplexity is looking for an experienced Product Data Scientist to accelerate the development of advanced search technologies. You will identify robust and sensitive signals from user behavior to help us gather insights from A/B experiment data more efficiently.

Responsibilities

  • Develop data-driven insights from user behavior to inform our product roadmap and accelerate adoption
  • Formulate hypotheses and validate them by designing, running, and analyzing A/B tests
  • Determine appropriate metrics and visualizations for tracking, and implement them in dashboards
  • Design new pipelines that will help to deliver better ranking quality. From discovering new signals, producing metrics and construct data labeling pipelines with human and LLM feedback

Qualifications

  • 4+ years of experience working as a data analyst or in a related role
  • Experience working on search-related products, with emphasis on designing online metrics and analyzing A/B experiments
  • Strong Python skills (expected to write production-grade code)
  • Proficiency with SQL
  • Experience with Business Intelligence (BI) tools
  • Deep knowledge of statistics

Preferred Qualifications

  • Proficiency with Apache Spark
  • Experience with Databricks
  • Experience with development of LLM-as-a-judge systems

Similar roles