Python Developer

Job Description

CPGvision is a recognized leader in Trade Promotion Management (TPM), Trade Promotion Optimization (TPO), and Revenue Growth Management (RGM). Leveraging the power of the Salesforce platform, we enable consumer goods companies to achieve their RGM objectives through our fully integrated, user-friendly solution suite.

About the Team

We are looking for a Python Developer specializing in OCR and web scraping to join our Data Science team. Your primary focus will be building and maintaining reliable OCR and data scraping pipelines for selected web portals and integrating them with OCR tools to extract structured information from diverse sources.

Work Mode

Fully remote.

Key Responsibilities

• Web Scraping: Design, develop, and maintain Python-based scrapers for targeted web portals, handling dynamic content, pagination, rate limiting, and anti-bot mechanisms.

• OCR Integration: Connect scraping pipelines with OCR tools to extract text and structured data from images, scanned documents, and PDFs.

• Data Pipeline & Storage: Build end-to-end data pipelines that collect, transform, and store scraped data in cloud storage, ensuring reliability and reproducibility.

• Cloud Infrastructure: Deploy and manage scraping jobs on AWS (EC2, S3, Lambda) with appropriate scheduling, monitoring, and error handling.

• Data Quality: Validate and clean extracted data, handle edge cases, and ensure output consistency across sources.

• Documentation: Document scraper architecture, data schemas, and operational procedures for handover and long-term maintainability.

You Must Have

• Proficiency in Python with strong experience in web scraping libraries (e.g. Scrapy, BeautifulSoup, Selenium, Playwright).

• Practical experience integrating OCR tools into data pipelines (e.g. Tesseract, cloud-based OCR services).

• Working knowledge of AWS, especially S3, EC2, and basic networking/scheduling (Lambda, EventBridge, or cron-based).

• Solid understanding of HTTP, HTML/CSS structure, browser DevTools, and common anti-scraping patterns.

• Experience with data parsing and transformation (JSON, XML, CSV) and libraries such as pandas.

• Familiarity with version control (Git) and clean coding practices.

• Comfortable working in a Linux terminal environment.

• Communicative English, sufficient for reading documentation and coordinating with the team.

Nice to Have

• Experience with headless browser automation at scale.

• Familiarity with proxy management, CAPTCHA handling, and IP rotation strategies.

• Knowledge of Docker for containerizing scraping services.

• Experience with task orchestration tools (e.g. Airflow, Prefect, Step Functions).

• Familiarity with SQL databases for structured data storage.

• Background in CPG/FMCG or Retail data domains.

What We Offer

• Fully remote work.

• Access to cloud infrastructure (AWS) for development and deployment.

• Collaboration with an experienced Data Science team working on real business problems in the CPG/Retail space.

• Clear project scope and technical support from the team.

 

PSignite invests in the development of its employees. We are committed and aspire to leverage the qualities and appreciate each person's unique competencies to bring to our company. We are an Equal Opportunity, Affirmative Action employer. Minorities, women, veterans, and individuals with disabilities are encouraged to apply.