About The Role
Were looking for an exceptional Automation Engineer who can build reliable, scalable systems for browser automation, crawling, and data extraction from the web. Your work will directly power our AI agents by enabling them to act like humans on the internetnavigating websites, filling forms, clicking buttons, and extracting structured insights from unstructured pages.
This role is ideal for someone who thrives on solving real-world problems using smart, practical automation and wants to be at the forefront of integrating this capability with AI.
Responsibilities
- Build and maintain scalable web scrapers, crawlers, and data extractors across varied platforms (including dynamic and JavaScript-heavy sites).
- Develop browser automation flows (e.g., Puppeteer, Playwright, Selenium) to mimic human actionsnavigation, form submission, interaction, etc.
- Design robust retry, failure-handling, and rate-limiting logic to ensure high reliability and compliance.
- Work closely with the AI team to wrap automation flows as APIs or callable modules usable by AI agents.
- Continuously monitor for site structure changes and adapt automation workflows accordingly.
- Maintain scraping infrastructure: job schedulers, proxies, headless browser management, and logging pipelines.
- Ensure all automation follows ethical guidelines and complies with legal and platform-specific terms of use.
Must-Have Skills
- 3-6 years of strong experience with web scraping tools and libraries (e.g., Puppeteer, Playwright, Selenium).
- Solid programming experience in Python or Node.js.
- Deep understanding of HTML, CSS, and browser DOM structures.
- Experience with headless browsers, captcha solving techniques, and rotating proxies.
- Comfort working with APIs, session-based authentication, and cookies.
- Ability to write clean, modular, and well-tested code.
Skills: apis,captcha solving,python,cookies,automation,css,web scraping,headless browsers,nodejs,rotating proxies,playwright,puppeteer,session-based authentication,html,selenium,node.js,browser dom
