Search by job, company or skills

  • Posted 7 hours ago
  • Over 50 applicants have applied

Job Description

 Roles and Responsibilities

  • Design, develop, and maintain large-scale data pipelines using Azure Data Factory (ADF) to extract, transform, and load data from various sources into Azure Databricks.
  • Develop complex ETL processes using Python scripts and SQL queries to process large datasets stored in Azure Data Lake Storage.
  • Collaborate with cross-functional teams to gather requirements for new data warehousing solutions and implement scalable architectures on Azure Data Warehouse.
  • Troubleshoot issues related to ADF pipeline failures, Azure Synapse connections, and SQL queries.

More Info

Job ID: 114471677

Similar Jobs

Chennai, India

Skills:

snowflake HadoopDatastageSparkSnowSQLSnowflake SQLdbtControl-M

Noida, India

Skills:

composer PysparkBigQueryDataprocSqlGcpDataFlowAzurePythonAWSData Modelling ConceptsdbtGCS

Bengaluru, India

Skills:

GithubUnixGitLinux Shell ScriptingPl SqlPythonSqlAws S3ETL processesOracle databasesControl-M

Bengaluru

Skills:

data engineering PythonSparkAzureCosmosDBEventHubDataLake

Bengaluru, India

Skills:

JavaData SecurityPostgreSQLSQL ServerApache SparkData GovernanceSqlDatabricksData ModellingTesting FrameworksPythonAWSAirflowBatch and streaming data pipelinesMonitoring and observability toolsData quality and validationdbtCI CD pipelines

Beware of Scammers

We don’t charge money for job offers