Location: 100% Remote
Schedule: Flexible, results-driven environment
Engagement: Long-term opportunity
About MeldIt
MeldIt develops large-scale social media automation and data intelligence solutions. Our platform manages campaigns across multiple brands and collects high-volume data from various social platforms. We focus on building robust, high-performance scraping and automation systems operating across multiple servers.
Role Overview
We are seeking a highly skilled Web Scraping and Automation Engineer with strong expertise in Python and complex reverse-engineering workflows. The ideal candidate is someone who can deconstruct any website's network behavior, manage advanced authentication flows, and deliver reliable, scalable scraping systems.
This role requires deep technical understanding, problem-solving capability, and the ability to work independently in a results-oriented environment.
Key Responsibilities
- Develop and maintain advanced, high-reliability scrapers using Python, Selenium, Playwright, or similar frameworks.
- Reverse-engineer network requests using DevTools, Network tab, and HAR files.
- Implement and automate complex authentication flows, including multi-step logins, token extraction, session handling, and CSRF/OAuth-based authentication.
- Integrate scraped data into backend environments involving Node.js, Next.js, and Prisma ORM.
- Build automated systems with strong error handling, retries, proxy management, and anti-bot mitigation strategies.
- Deploy scraping services across multiple servers and cloud environments, including AWS Lambda and virtual machines.
- Collaborate with engineering teams to ensure seamless data delivery and system reliability.
Required Skills
- Strong proficiency in Python, specifically for scraping, automation, and API interaction.
- Expertise in reverse-engineering network operations and browser traffic.
- Hands-on experience with browser automation tools (Selenium, Playwright, Puppeteer).
- Ability to automate complex login and authentication processes.
- Good understanding of proxies, headers, user-agent strategies, cookies, and bot detection countermeasures.
- Experience with Git, microservices architecture, and cloud deployment.
Preferred Skills
- Familiarity with Node.js, Next.js, and Prisma ORM.
- Experience with serverless scraping (AWS Lambda).
- Background in machine learning, analytics, or sentiment analysis.
- Experience building large-scale or distributed scraping systems.
What We Offer
- Fully remote work environment.
- Flexible working hours with a results-focused culture.
- Opportunity to work on technically challenging automation and data-engineering systems.
- High degree of ownership and autonomy over scraping pipelines and infrastructure.
Application Details
Interested candidates should provide:
- GitHub or portfolio links
- Examples of complex automation or scraping projects
- A brief description of challenging scraping problems they have solved
