Position: Python Data Engineer
Location: Chennai
Working Type: WFO (Full time)
Resource Count: 1
Shift: UK Shift (2:00 - 11:00 PM)
Experience : 6+ years overall
Interviews: Assessment || 2 Interview rounds.
Key Responsibilities
- Design, develop, and maintain scalable, resilient data pipelines and ETL frameworks in cloud environments to support advanced analytics and AI/ML initiatives.
- Build optimized data processing solutions, database architectures, and reusable frameworks for large-scale data ingestion, transformation, and validation.
- Develop high-performance Python- and SQL-based solutions for complex data processing and analytical workloads.
- Collaborate with cross-functional teams to translate business requirements into scalable technical solutions and actionable insights.
- Ensure data quality, governance, reliability, and operational efficiency through robust testing, monitoring, and engineering best practices.
Technical Skills And Experience Requirements
- Minimum 6+ years of hands-on experience designing, building, deploying, testing, maintaining, monitoring, and owning scalable, resilient, distributed data pipelines.
- Strong proficiency in Python for large-scale distributed data processing.
- Advanced Python development experience including Python 3.x, OOP, asynchronous programming, performance optimization, Airflow orchestration, REST APIs, cloud SDK integrations (Azure), testing frameworks, and Python packaging/dependency management.
- Hands-on experience with Pandas, SQLAlchemy and PyODBC for data processing and database interactions.
- Expert-level ability to write complex, optimized queries on large-scale datasets.
- Experience with RDBMS and OLAP systems such as MySQL and Snowflake.
- Familiarity with Agile methodologies and architectural best practices for scalable data lake solutions.
