Data Engineer

Data Engineer - Web Scraping & Mobile Data Acquisition

Job Title: Data Engineer

Specialization: Web Scraping & Mobile Application Data Acquisition

Experience: 3-7 Years

Location: Bangalore | Gurugram | Pune | Hyderabad | Mumbai

Work Model: Hybrid (2 Days Office | 3 Days Work from Home)

About the Role

We are looking for skilled Python Data Engineers with hands-on experience in large-scale web scraping and mobile application data extraction. This role goes beyond traditional web scraping-you will work on extracting structured data from modern websites as well as Android/iOS applications by analyzing APIs, handling authentication mechanisms, bypassing anti-bot protections, and building scalable, production-grade data acquisition pipelines.

Required Skills

• Python
• SQL
• Scrapy
• Selenium
• Playwright
• BeautifulSoup
• XPath
• HTML
• JavaScript
• JSON/XML Parsing

Mobile Scraping

• Android / iOS Data Extraction
• Mobile API Analysis
• Network Traffic Interception
• Reverse Engineering APIs
• Charles Proxy / Burp Suite
• Authentication Handling
• Cookies & Session Management
• HTTP / HTTP2
• HTTPS
• WebSockets
• REST APIs
• OAuth
• JWT Tokens
• Proxy Rotation
• CAPTCHA Handling
• Headless Browsers
• Distributed Crawling
• Job Scheduling
• Anti-Bot Bypass Techniques

Good to Have

• Spark
• Kafka
• Cloud Platforms
• Docker
• Linux

Python | Web Scraping | Mobile Scraping | Data Acquisition | Data Extraction | Scrapy | Selenium | Playwright | BeautifulSoup | Mobile APIs | Android | iOS | Reverse Engineering | Burp Suite | Charles Proxy | HTTP | WebSockets | OAuth | JWT | SQL | Proxy Management | CAPTCHA | Crawlers | Data Engineering