Search by job, company or skills

This job is no longer accepting applications

Job Description

About The Role

We are looking for a talented Data Engineer with 2–3 years of experience in building scalable data pipelines and managing large datasets. The ideal candidate should have expertise in SQL, Python, ETL processes, cloud platforms, and data warehousing technologies.

Key Responsibilities

  • Design, develop, and maintain scalable data pipelines.
  • Build ETL/ELT workflows for data ingestion and transformation.
  • Develop and optimize SQL queries for large datasets.
  • Work with structured and unstructured data from multiple sources.
  • Maintain data quality, integrity, and security.
  • Design and manage data warehouses and data lakes.
  • Collaborate with Data Analysts, Data Scientists, and Software Engineers.
  • Monitor pipeline performance and troubleshoot data issues.
  • Create documentation for data architecture and workflows.

Required Skills

  • Strong proficiency in SQL and Python.
  • Hands-on experience with ETL tools and data integration.
  • Experience with Apache Spark, Hadoop, or Kafka.
  • Knowledge of cloud platforms such as AWS, Azure, or GCP.
  • Experience with data warehousing solutions like Snowflake, Redshift, BigQuery, or Azure Synapse.
  • Familiarity with Airflow or similar workflow orchestration tools.
  • Understanding of database design and data modeling.
  • Experience with Git and version control.

Preferred Skills

  • Knowledge of PySpark.
  • Experience with real-time data streaming.
  • Understanding of data governance and security best practices.
  • Familiarity with BI tools such as Power BI or Tableau.
  • Strong analytical and problem-solving skills.

Qualification

  • Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a related field.

Skills: sql,design,gcp,azure,aws,python,etl,data warehousing,spark,kafka

More Info

Job Type:
Industry:
Employment Type:

Job ID: 150823877

Similar Jobs

Gurugram, India

Skills:

data engineering Data TransformationPower BiData ModelingSqlELTGitMicrosoft AzurePythonEtlAzure DevOpstable maintenancedata quality checksOneLakedata pipelinesschema validationSpark notebookscloud data platformsADF pipelinesLakehouse tablesMicrosoft Fabric

Delhi, India

Skills:

Strong SQL including analytical functions and query optimisationFluent use of coding agents and LLM toolingTesting lineage and governanceETL and ELT batch and streaming in PythonProduction ownership of data systems

Gurugram, Gurugram, India

Skills:

BigQueryHadoopPysparkData WarehousingBashSparksqlDataprocSqlCloud StorageHiveGcpIamDataFlowPythonAirflowDataFramePub Sub

Gurugram, Gurugram, India

Skills:

JavaHiveHadoopScalaSparkNodejsEmrPythonSqlAI code generation tools

Noida, India

Skills:

BigQueryLoggingTableauSqlGcpApp EnginePythonGCP IAMLookerMonitoringProduction SupportAI LLM applicationsSpannerbatch streaming pipelines

Beware of Scammers

We don’t charge money for job offers