Search by job, company or skills

Principal Data Engineer

4-6 Years
Early Applicant
  • Posted 11 days ago
  • Be among the first 20 applicants

Job Description

Position summary

The Senior Data Engineer (P3) is a strong individual contributor responsible for designing, building, and owning the data pipelines and transformation layer that power our Enterprise Data platform.

You'll work closely with data architects, analysts, and cross-functional teams to deliver reliable, well-governed data across its full life cycle—from ingestion through to analytics-ready, trusted datasets.

Key responsibilities

Design, build, and maintain scalable ETL/ELT pipelines using Python and Apache Airflow.

Own the dbt Core transformation layer, including models, tests, documentation, and deployment.

Manage the full data life cycle across ingestion, transformation, quality, storage, and retention.

Define data management standards for data quality, cataloging, and lineage.

Administer and optimize the Airflow environment, including Cloud Composer where applicable.

Collaborate with data architects, analysts, and cross-functional teams to deliver reliable data pipelines.

Conduct design and code reviews.

Mentor junior data engineers.

Troubleshoot and resolve production data pipeline issues.

Required Qualifications

4+ years of experience in data engineering.

Strong experience with

Python

Apache Airflow

ETL/ELT pipeline architecture

dbt Core

Strong understanding of data management principles and the end-to-end data life cycle.

Experience with SQL and relational or cloud data warehouse platforms.

Experience with Git-based workflows and CI/CD for data pipelines.

Understanding of Agile development methodologies.

Experience writing automated tests for data pipelines and dbt models.

Preferred Qualifications

Experience with Google Cloud Platform (GCP).

Experience with Google Cloud Storage (GCS).

Experience with Cloud Composer.

More Info

Job Type:
Industry:
Employment Type:

About Company

Job ID: 151606959

Similar Jobs

Pune, India

Skills:

S3Aws ServicesData WarehousingKafkaEmrRedshiftELTHiveRDBMSMySQLIamSparkAb InitioOracleEtlMSKLakehouse engineeringConfluentinfrastructure-as-codeGluecontainerized workloads

Pune, India

Skills:

snowflake S3Data ArchitectureRedshiftSqlDevopsTerraformPythonAWSLangChainAirflowGitOpsCloud-native data platform infrastructureMLflowInfrastructure-as-codeDeployment automationData ingestionSnowparkdbt

Pune, India

Skills:

Data FactoryPower BiScalaApache SparkPythonSqlAzure DevOpsAirflowOneLakeRMicrosoft Fabric

Pune, India

Skills:

SqlEtlPerformance EngineeringPysparkSecurity best practicesData lifecycle managementIcebergParquet file format

Pune, India

Skills:

Machine Learningdata miningClusteringSqlPandasNumpyPowerbiMatplotlibPythondata visualization in MS-exceladvanced statistical analysisstreamlitGLM RegressionTime Series ForecastingBoosting Trees

Beware of Scammers

We don’t charge money for job offers