Python Developer

Job Title: Python Developer – Web Scraping & Automation

Experience: 5+ Years

Location: Mumbai/Pune

About the Role

We are seeking a skilled Python Developer with strong hands-on experience in web scraping, automation, and scripting to join our growing team. The ideal candidate will be responsible for building reliable data extraction solutions, handling dynamic and protected websites, and delivering high-quality structured data to support business needs.

Key Responsibilities:

• Design, develop, and maintain robust Python scripts for automation, data processing, and workflow optimization.
• Build, enhance, and manage web scrapers using frameworks and libraries such as BeautifulSoup, Scrapy, Playwright, and similar tools.
• Handle anti-scraping mechanisms including CAPTCHAs, IP blocking, rate limiting, and JavaScript-rendered content using Selenium, Playwright, or Puppeteer.
• Integrate and consume REST APIs and third-party data sources into internal systems and pipelines.
• Clean, transform, and store extracted data using Pandas, relational databases (PostgreSQL, MySQL), or NoSQL databases (MongoDB).
• Ensure all scripts follow PEP 8 standards, with clean, modular, maintainable, and well-documented code.
• Schedule, automate, and monitor scraping jobs using tools such as Cron, Apache Airflow, or Celery.
• Debug, optimize, and scale existing scraping and automation solutions to ensure performance and reliability.
• Collaborate closely with data, product, and business teams to gather requirements and deliver structured datasets within timelines.
• Maintain documentation for scraping logic, workflows, and operational processes.

Required Skills & Qualifications:

• 5+ years of experience in Python development, with a strong focus on automation and web scraping.
• Proven expertise in web scraping frameworks and browser automation tools.
• Strong understanding of HTML, CSS, JavaScript, and DOM manipulation.
• Experience working with RESTful APIs and data integration.
• Proficiency in data manipulation and storage using Pandas, SQL, and NoSQL databases.
• Experience with job scheduling and orchestration tools (Cron, Airflow, Celery).
• Strong debugging, analytical, and problem-solving skills.
• Ability to write clean, maintainable, and well-documented code.
• Demonstrated ability to manage scraping projects at scale.

Good to Have:

• Experience with cloud platforms (AWS, Azure, or GCP).
• Knowledge of containerization (Docker).
• Familiarity with proxy management and rotating IP solutions.
• Experience working in Agile/Scrum development environments.

Key Competencies:

• Attention to detail
• Strong communication and collaboration skills
• Ownership and accountability
• Ability to work independently and meet deadlines

Note:1. Applications will only be accepted through the ATS link provided above. Profiles shared through other means will not be considered.

2. Prolegion does not charge any fee from candidates at any stage. If anyone approaches you for money in exchange for this opportunity, treat it as fraud and report it to us immediately.