Position: Python Developer (SQL + ETL Pipeline)
Location: Chennai
Experience: 5+ years
Key Responsibilities
- Develop and maintain robust, scalable, and efficient Python-based data pipelines
- Design and implement complex ETL workflows for transforming and integrating structured and unstructured data
- Write complex SQL queries to extract and manipulate data from various relational databases
- Collaborate with data engineering teams to ensure data quality, integrity, and consistency across systems
- Implement and maintain CI/CD pipelines for automated testing, integration, and deployment of code
- Optimize data flow and pipeline architecture for performance and scalability
- Participate in code reviews, technical design discussions, and agile ceremonies
- Monitor and troubleshoot data processing jobs and ensure production stability
Required Qualifications
- 5+ years of hands-on experience in Python development
- Strong proficiency in SQL (e.g., joins, window functions, optimization techniques)
- Solid experience building and maintaining ETL processes
- Familiarity with data pipeline orchestration tools (e.g., Airflow, Luigi, Prefect preferred)
- Experience with CI/CD tools (e.g., Jenkins, GitLab CI/CD, GitHub Actions)
- Strong understanding of version control systems, especially Git
- Good knowledge of working with cloud platforms (AWS, GCP, or Azure preferred)
- Strong problem-solving skills and attention to detail
- Excellent verbal and written communication skills
