Data Engineer
isitca private limited- Posted 2 months ago
- Over 50 applicants have applied
Job Description
About the Role: We are looking for a hands-on Data Engineer to join our team and take full ownership of scraping pipelines and data quality. You'll be working on data from 60+ websites involving PDFs, processed via OCR and stored in MySQL/PostgreSQL. You'll build robust, self-healing pipelines and fix common data issues (missing fields, duplication, formatting errors).
Responsibilities:
Own and optimize Airflow scraping DAGs for 60+ sites
Implement validation checks, retry logic, and error alerts
Build pre-processing routines to clean OCR'd text
Create data normalization and deduplication workflows
Maintain data integrity across MySQL and PostgreSQL
Collaborate with ML team for downstream AI use cases
Requirements:
2–5 years of experience in Python-based data engineering
Experience with Airflow, Pandas, OCR (Tesseract or AWS Textract)
Solid SQL and schema design skills (MySQL/PostgreSQL)
Familiarity with CSV processing and data pipelines
Bonus: Experience with scraping using Scrapy or Selenium
Location: Delhi (in-office only)
Salary Range : 50-80k/Month
More Info
About Company
