Job Title: Python Data Engineer
Location: Bangalore
Experience: 5-10 Years
Job Summary
We are seeking a skilled Python Data Engineer to design, develop, and optimize scalable data pipelines and data platforms. The ideal candidate will have strong expertise in Python, SQL, and modern data engineering tools, with experience in building robust ETL/ELT workflows and supporting analytics and business intelligence initiatives.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines using Python.
- Build and optimize ETL/ELT processes for structured and unstructured data.
- Develop reusable data processing frameworks and automation scripts.
- Work with large datasets and ensure data quality, integrity, and performance.
- Collaborate with Data Scientists, Analysts, and business stakeholders to support data needs.
- Implement data validation, transformation, and cleansing processes.
- Optimize database queries and improve data processing efficiency.
- Support CI/CD and deployment of data workflows.
- Monitor and troubleshoot production data issues.
Required Skills
- Strong proficiency in Python (Pandas, NumPy, PySpark).
- Solid experience with SQL and database systems (MySQL, PostgreSQL, SQL Server, etc.).
- Experience with data processing frameworks such as Spark or similar tools.
- Hands-on experience building ETL/ELT pipelines.
- Familiarity with cloud platforms (AWS, Azure, or GCP).
- Understanding of data modeling and data warehousing concepts.
- Experience with version control tools like Git.
