Data Engineer, Anti Scraping, Third Party Data Operations
Google · Mountain View, California, United States · $156K–$227K/yr
Software Development · 10,001+ employees
About the role
Architect and maintain data pipelines to ingest and process logs for scraping detection and analysis within the Geo Anti-Scraping Program. Develop automated solutions, data quality frameworks, and dashboards to mitigate scraping threats and improve operational efficiency.
What they look for
Requirements
Requires a bachelor's degree and at least 5 years of experience building production-grade ETL pipelines. Candidates must be proficient in Python or Java and have experience applying AI/ML techniques to security, fraud, or anti-abuse detection.
Benefits
Full description
Minimum qualifications:
- Bachelor's degree or equivalent practical experience.
- 5 years of experience designing, building, and managing production-grade ETL pipelines.
- Experience writing readable, structured code (e.g., Python, Java) and applying AI/ML libraries/frameworks (e.g., TensorFlow, Vertex AI) within data systems.
- Experience applying AI/ML techniques to anti-abuse, security, or fraud detection.
Preferred qualifications:
- Experience with AI to drive automation for data pipelines and data quality.
- Experience with data logging, monitoring, and analysis tools.
- Familiarity with distributed systems.
- Understanding of bot detection techniques and adversarial machine learning.
- Ability to manage project timelines and deliverables effectively.
- Excellent stakeholder engagement skills, with experience working with both internal teams and external vendors.
About the job:
In this role, you will support the GASP team which builds technology to protect Geo assets at scale. As a Data Engineer, you will build and manage data pipelines to ensure data sources can be consumed by the Geo Anti-Scraping Program (GASP) for abuse and scraping detection, monitoring and measurement.The Geo team is focused on building the most accurate, comprehensive, and useful maps for our users, through products like Maps, Earth, Street View, Google Maps Platform, and more. Every month, more than a billion people rely on Maps services to explore the world and navigate their daily lives.
The Geo team also enables developers to use the power of Google Maps platforms to enhance their apps and websites. As they plot a course for the future of mapping, they are solving complex computer science problems, designing beautiful and intuitive product experiences, and improving our understanding of the real world.
Individual pay is determined by factors including job-related skills, experience, and relevant education or training.
US: $156000 - $227000 (USD) + 15% bonus target + equity + benefits
Learn more about benefits at Google. Responsibilities:
- Architect, build, and maintain data pipelines to ingest, process, and transform logs and signals from various Geo services for scraping detection and analysis.
- Implement and manage data quality frameworks, leveraging AI and automation to enhance data ingestion, ensure data integrity, and improve the accuracy of anti-scraping models and analytics.
- Develop and maintain curated datasets, reports, queries, and dashboards to support client users in understanding and mitigating scraping threats.
- Drive the creation of automated solutions and self-service tools to accelerate data-driven decision-making and improve the efficiency of anti-scraping operations and partner care experiences.
- Provide operational support for anti-scraping data systems, including performance monitoring, post-launch issue resolution, proactive planning for dependency changes and system migrations, while defining and driving the long-term technical goal and roadmap for a scalable, resilient, and cost-effective anti-scraping data infrastructure for Google Maps.
