Lead Software Engineer - Data Engineer

We are seeking a Senior Data Engineer to join our growing team in Pune. The ideal candidate will have strong hands-on experience in Python, GCP (BigQuery), PySpark, Snowflake, and GitHub, and will be responsible for designing, building, and maintaining scalable, cloud-native data pipelines.

This is an excellent opportunity to work on enterprise-level data platforms that enable advanced analytics, reporting, and decision-making across the organization.

Key Responsibilities:

• Design, develop, and maintain robust ETL/ELT data pipelines using Python and PySpark.
• Work extensively with GCP BigQuery and Snowflake for data warehousing and analytics.
• Implement data transformation, quality checks, and integration with various data sources.
• Optimize and refactor existing data pipelines to improve performance, scalability, and reliability.
• Collaborate with data architects, analysts, and business stakeholders to understand requirements and deliver data solutions.
• Manage code versioning and collaboration using GitHub and CI/CD practices.
• Ensure data security, governance, and compliance with enterprise standards.
• Troubleshoot and resolve data issues across development, test, and production environments.

Required Skills & Experience:

• 8–11 years of total experience in data engineering or related roles.
• Strong programming skills in Python and experience with PySpark.
• Hands-on experience with Google Cloud Platform (GCP), particularly BigQuery.
• Experience with Snowflake data platform for warehousing and analytics.
• Solid understanding of data modeling, performance tuning, and data pipeline orchestration.
• Proficient with Git/GitHub for version control and collaboration.
• Exposure to CI/CD pipelines and data workflow automation tools (e.g., Airflow, Cloud Composer).
• Familiarity with data governance, security, and compliance best practices.

Preferred Qualifications:

• GCP or Snowflake certification(s).
• Experience with streaming data frameworks (e.g., Kafka, Pub/Sub) is a plus.
• Knowledge of other cloud platforms (AWS, Azure) is a bonus.
• Strong communication and stakeholder management skills.