
Search by job, company or skills
About the Company
Position :Data Engineer ( Azure + Databricks + Fivetran /HVR)
Total Experience : 7-12 Years
Relevant Experience : 4 Years Data Engineer
Locations : India
Mode of the Work : Hybrid
Shift Timings : UK Shift : 2:00 Pm to 10:00 Pm (Or) 3:00 Pm to 11:00 Pm (Depends upon the project)
Notice Period : 0- 45 Days Serving Notice Period or Immediate
Domain : pharma, Health Care (Mandatory)
Job Description :
Build and optimize ETL/ELT workflows for structured and unstructured data. Implement data ingestion frameworks from multiple sources (APIs, databases, streaming platforms). Develop and maintain data warehouses and data lakes (Azure Data Lake Storage Gen2). Ensure data quality, integrity, and reliability through monitoring and validation processes. Work with stakeholders to understand data requirements and translate them into scalable solutions. Optimize performance and cost of Azure data services. Implement security and governance using Azure tools (RBAC, Managed Identity, Key Vault). Collaborate with data scientists, analysts, and BI teams to support analytics workloads. Maintain proper documentation for data architecture and pipelines. Troubleshoot issues and provide production support. Design, develop, and maintain data pipelines using Azure services such as: Azure Data Factory (ADF) - Mandatory Azure Synapse Analytics- Mandatory Azure Databricks- Mandatory PythonSQL
About the Role
Build and optimize ETL/ELT workflows for structured and unstructured data.
Responsibilities
Qualifications
Education details
Required Skills
Azure Data Factory (ADF), Azure Synapse Analytics, Azure Databricks, Python, SQL
Preferred Skills
None specified
Pay range and compensation package
Not specified
Equal Opportunity Statement
We are committed to diversity and inclusivity.
Job ID: 152042795
Skills:
S3, Gdpr, Cloudformation, PowerShell, Hipaa, Bash, Google Cloud, Encryption, Ec2, Terraform, Ansible, Iam, Load Balancers, Azure, Python, Kubernetes, AWS, DNS configurations, VPCs

Skills:
distributed storage , Java, Machine Learning, Apis, Kafka, Performance Tuning, Gcp, Docker, Spark, Python, Kubernetes, AWS, Pinot, ClickHouse, Ai, Caching, Flink, Iceberg
Skills:
Java, Golang, RDS, Security Groups, Cloudformation, Dynamodb, Windows, Lambda, Linux, Docker, ECS, Python, AWS, Api Gateway, Aurora, ALB
Skills:
Docker, Terraform, Cloudformation, PowerShell, Bash, Python, Kubernetes, AWS cloud services
Skills:
automation testing, Api Testing, Stlc, Sdlc, version control Git, UiPath Test Cloud, SQL databases, software testing principles