Search by job, company or skills

Senior Data Engineer

Early Applicant
  • Posted 2 days ago
  • Be among the first 10 applicants

Job Description

Skills: DBT + Python + Pyspark + SQL + Data Modelling Concepts + any Cloud + GCP

Experience: 5-8 yrs

Location: Greater Noida, Hyderabad, Pune

Job Summary

We are seeking an experienced Senior Data Engineer with a strong background in designing, building, and managing scalable data solutions. The ideal candidate should have hands-on expertise in developing data pipelines, data transformation frameworks, cloud-based data platforms, and modern analytics ecosystems. This role requires deep knowledge of SQL, data modeling, DBT, and cloud technologies, with preference given to candidates experienced in Google Cloud Platform (GCP).

Key Responsibilities

  • Design, develop, and maintain scalable ETL/ELT data pipelines.
  • Build and enhance data transformation workflows using DBT.
  • Develop and optimize data models to support analytical and business reporting requirements.
  • Perform data validation, cleansing, reconciliation, and data quality checks.
  • Write efficient and optimized SQL queries for data extraction, transformation, and analysis.
  • Manage and support cloud-based data engineering workloads, preferably on GCP.
  • Collaborate with cross-functional teams to understand business and technical requirements.
  • Monitor data pipelines, troubleshoot failures, and ensure data reliability and availability.
  • Implement best practices for data governance, documentation, and metadata management.
  • Support automation, deployment, and version control processes using CI/CD and Git.
  • Mentor junior team members and provide technical guidance on data engineering best practices.

Required Skills

  • Strong experience in Data Engineering and data warehouse development.
  • Hands-on expertise with DBT (Data Build Tool).
  • Advanced proficiency in SQL with experience in performance tuning and query optimization.
  • Strong understanding of Data Modeling, including Dimensional Modeling Star Scheme and Snowflake Schema
  • Experience designing and implementing ETL/ELT pipelines.
  • Hands-on experience with at least one cloud platform: GCP (Preferred): BigQuery, Dataflow, Dataproc, Cloud Composer, Google Cloud Storage (GCS)
  • OR equivalent services on AWS/Azure.
  • Strong programming skills in Python for data processing and automation.
  • Experience working with large-scale data transformation and loading technologies.

More Info

Job Type:
Industry:
Employment Type:

About Company

Job ID: 153333447

Similar Jobs

Gurugram, India

Skills:

Data ModelingSqlSparkData IntegrationPythondata pipeline developmentOneLakeschema managementdata quality frameworksReconciliationincremental processingPipelinesNotebookspartitioningperformance optimizationLakehouse architectureMicrosoft FabricAzure data servicesValidation

Gurugram, Gurugram, India

Skills:

AzurePythonAWSETL ELT toolsdata pipeline developmentSnowflake SQL

Gurugram, Gurugram, India

Skills:

amazon emr Aws LambdaCloudformationAmazon KinesisPysparkAmazon S3AWS GlueSqlTerraformAmazon RedshiftPythonAWS CDKAWS DMSAmazon MWAAAWS Step FunctionsAWS Lake Formation

Noida, India

Skills:

KubernetesApache SparkHadoopNumpyPysparkKafkaPandasAWSNode.jsFastAPIAzureDockerFlaskData ModelingMilvusLlamaIndexGenAI LLMsPython EcosystemDatabricks Delta LakeLangChainPinecone

Remote

Skills:

Data EngineerPythonSqlPandasBigQueryEtlDockerPolar

Beware of Scammers

We don’t charge money for job offers