JobCubby JobCubby
Sign up
CXG

Data Engineer - Web Scraping (3 months contract)

CXG India

Business Consulting and Services · 201-500 employees

6 h ago
Remote data-engineer Mid (2-5 yrs) Contractor India
Create a free account to apply — email only, no card. You can also save this posting or score it against your profile with AI.

Applying here? Try the free cover letter tool — paste this posting and your résumé, no account needed.

About the role

Maintain and monitor Python-based website scraping configurations, review retrieved data for errors or blockages, and coordinate requirements and issue reporting with stakeholders. Build data ingestion pipelines into the data lake, perform transformations, and provide periodic reports on scraping activities.

What they look for

Python Web Scraping Data Engineering ETL Data Modeling Data Warehousing Airflow DBT SQL NoSQL Azure Data Security Data Pipeline Optimization Git Terraform Stakeholder Collaboration

Requirements

Requires at least two years of relevant experience, strong Python and data engineering expertise, and experience with scalable architectures, ETL, databases, cloud platforms, and pipeline optimization. Airflow and/or DBT, Azure, Terraform, Git, data security knowledge, collaboration skills, and a strong academic background are also sought; English fluency is required, while French is a plus.

Full description

We are growing! We are currently looking to hire a Data Engineer - Web Scraping to work with us remotely on a 3 months contract.

Who we are:

Founded in 2006, CXG is a global customer experience company uniquely positioned at the intersection of data-driven retail performance, customer experience transformation, and operational execution across 200+ luxury brands worldwide.  

The mission of our 270 collaborators is to help brands transform customer and employee experiences through tailored insights, strategy, and implementation.  

We are passionate about delivering impact. 

Our clients include the world’s most admired luxury houses, and our solutions combine research, technology, and human expertise to elevate every customer interaction.

What you will be doing:

  • Maintain and manage website scraping configurations using Python.
  • Monitor scraping configurations for errors and potential crashes.
  • Oversee retrieved data to detect potential issues and blockages.
  • Coordinate with stakeholders to understand scraping task requirements and report issues.
  • Prepare and share periodic reports on scraping activities with stakeholders.
  • Develop necessary pipelines to ingest data into the Datalake and perform required transformations.

What you will bring along:

  • Proven experience in data engineering with expertise in designing and implementing scalable data architectures.
  • Strong experience with ETL processes, data modeling, and data warehousing (Airflow & DBT preferred).
  • Expertise in database technologies, both relational (SQL) and NoSQL.
  • Knowledge of cloud platforms, particularly Azure.
  • Solid understanding of data security measures and compliance standards.
  • Excellent Python experience for data engineering and automation.
  • Strong collaboration skills to work closely with data scientists and analysts.
  • Ability to optimize data pipelines for performance and efficiency.
  • Ability to build, test, and maintain tasks and projects.
  • Experience with version control systems, such as Git.
  • Hands-on experience with Airflow and/or DBT.
  • Experience with Terraform for infrastructure management.
  • Minimum 2 years of experience in a similar role.
  • Strong academic background in a relevant field.
  • Fluent in English (French is a plus).

Similar roles