Search by job, company or skills

7-12 Years
Early Applicant
  • Posted 25 days ago
  • Be among the first 10 applicants

Job Description

About the Company

Position :Data Engineer ( Azure + Databricks + Fivetran /HVR)

Total Experience : 7-12 Years

Relevant Experience : 4 Years Data Engineer

Locations : India

Mode of the Work : Hybrid

Shift Timings : UK Shift : 2:00 Pm to 10:00 Pm (Or) 3:00 Pm to 11:00 Pm (Depends upon the project)

Notice Period : 0- 45 Days Serving Notice Period or Immediate

Domain : pharma, Health Care (Mandatory)

Job Description :

Build and optimize ETL/ELT workflows for structured and unstructured data. Implement data ingestion frameworks from multiple sources (APIs, databases, streaming platforms). Develop and maintain data warehouses and data lakes (Azure Data Lake Storage Gen2). Ensure data quality, integrity, and reliability through monitoring and validation processes. Work with stakeholders to understand data requirements and translate them into scalable solutions. Optimize performance and cost of Azure data services. Implement security and governance using Azure tools (RBAC, Managed Identity, Key Vault). Collaborate with data scientists, analysts, and BI teams to support analytics workloads. Maintain proper documentation for data architecture and pipelines. Troubleshoot issues and provide production support. Design, develop, and maintain data pipelines using Azure services such as: Azure Data Factory (ADF) - Mandatory Azure Synapse Analytics- Mandatory Azure Databricks- Mandatory PythonSQL

About the Role

Build and optimize ETL/ELT workflows for structured and unstructured data.

Responsibilities

  • Implement data ingestion frameworks from multiple sources (APIs, databases, streaming platforms).
  • Develop and maintain data warehouses and data lakes (Azure Data Lake Storage Gen2).
  • Ensure data quality, integrity, and reliability through monitoring and validation processes.
  • Work with stakeholders to understand data requirements and translate them into scalable solutions.
  • Optimize performance and cost of Azure data services.
  • Implement security and governance using Azure tools (RBAC, Managed Identity, Key Vault).
  • Collaborate with data scientists, analysts, and BI teams to support analytics workloads.
  • Maintain proper documentation for data architecture and pipelines.
  • Troubleshoot issues and provide production support.
  • Design, develop, and maintain data pipelines using Azure services such as: Azure Data Factory (ADF) - Mandatory, Azure Synapse Analytics- Mandatory, Azure Databricks- Mandatory, PythonSQL.

Qualifications

Education details

Required Skills

Azure Data Factory (ADF), Azure Synapse Analytics, Azure Databricks, Python, SQL

Preferred Skills

None specified

Pay range and compensation package

Not specified

Equal Opportunity Statement

We are committed to diversity and inclusivity.

More Info

Job Type:
Industry:
Employment Type:

Job ID: 152042795

Similar Jobs

Delhi, India

Skills:

S3GdprCloudformationPowerShellHipaaBashGoogle CloudEncryptionEc2TerraformAnsibleIamLoad BalancersAzurePythonKubernetesAWSDNS configurationsVPCs

Bengaluru, India

Skills:

distributed storage JavaMachine LearningApisKafkaPerformance TuningGcpDockerSparkPythonKubernetesAWSPinotClickHouseAiCachingFlinkIceberg

Thiruvananthapuram / Trivandrum, India

Skills:

JavaGolangRDSSecurity GroupsCloudformationDynamodbWindowsLambdaLinuxDockerECSPythonAWSApi GatewayAuroraALB

India

Skills:

DockerTerraformCloudformationPowerShellBashPythonKubernetesAWS cloud services

India

Skills:

automation testingApi TestingStlcSdlcversion control GitUiPath Test CloudSQL databasessoftware testing principles

Beware of Scammers

We don’t charge money for job offers