Senior Azure Data Engineer

Role Senior Azure Data Engineer

Required Technical Skill Set Databricks and Azure services

Desired Experience Range 5 Years

Location of Requirement Hyderabad, India

Contract and Onsite role

Resources who can join immediately.

Desired Competencies (Technical/Behavioral Competency)

Must-Have (Ideally should have more than 3 years

Python

SQL and NoSQL databases

Databricks/ PySpark (Structured streaming & batch)

Experience with Azure: ADLS, Databricks, EventHub, Event Grid, SQL DW, Azure Functions, Serverless Architecture,

Experience with Azure DevOps pipelines (CI/CD)

Terraform (must: theory, nice: practical experience)

Good knowledge of Git (branches, pull requests, fixing merge conflicts)

Good-to-Have

Experience with ARM Templates, Azure Data Factory

Knowledge on Kubernetes and Google Cloud Platform.

Machine learning and AI.

Responsibility of / Expectations from the Role 

Ability to design solutions independently based on high-level architecture. 

Implementation including loading from disparate data sets, preprocessing using Azure data bricks

Work with customers in gathering business requirements for data pipeline/lake/migration needs

Monitoring Azure DevOps, data bricks pipelines and participate support activities

Willing to learn Azure monitoring services and logging services

#azure #devops #databricks #arm #git #googlecloudplatform #kubernetes

• Interested consultants may please share your cv to [Confidential Information]