We are seeking a Senior Data Engineer to join our growing team in Pune. The ideal candidate will have strong hands-on experience in Python, GCP (BigQuery), PySpark, Snowflake, and GitHub, and will be responsible for designing, building, and maintaining scalable, cloud-native data pipelines.

This is an excellent opportunity to work on enterprise-level data platforms that enable advanced analytics, reporting, and decision-making across the organization.

Key Responsibilities:

Design, develop, and maintain robust ETL/ELT data pipelines using Python and PySpark.
Work extensively with GCP BigQuery and Snowflake for data warehousing and analytics.
Implement data transformation, quality checks, and integration with various data sources.
Optimize and refactor existing data pipelines to improve performance, scalability, and reliability.
Collaborate with data architects, analysts, and business stakeholders to understand requirements and deliver data solutions.
Manage code versioning and collaboration using GitHub and CI/CD practices.
Ensure data security, governance, and compliance with enterprise standards.
Troubleshoot and resolve data issues across development, test, and production environments.

Required Skills & Experience:

8–11 years of total experience in data engineering or related roles.
Strong programming skills in Python and experience with PySpark.
Hands-on experience with Google Cloud Platform (GCP), particularly BigQuery.
Experience with Snowflake data platform for warehousing and analytics.
Solid understanding of data modeling, performance tuning, and data pipeline orchestration.
Proficient with Git/GitHub for version control and collaboration.
Exposure to CI/CD pipelines and data workflow automation tools (e.g., Airflow, Cloud Composer).
Familiarity with data governance, security, and compliance best practices.

Preferred Qualifications:

GCP or Snowflake certification(s).
Experience with streaming data frameworks (e.g., Kafka, Pub/Sub) is a plus.
Knowledge of other cloud platforms (AWS, Azure) is a bonus.
Strong communication and stakeholder management skills.

Lead Palantir Data Software Engineer

Lead Software Engineer - Data Engineer