S
Lead Azure Data engineer
S
Lead Azure Data engineer
swits digital private limitedEarly Applicant
- Posted 10 hours ago
- Be among the first 10 applicants
Job Description
Job Title:Lead - Azure Data Engineer
Experience: 5+ Years
Location: Gurugram, Pune, Hyderabad, Bengaluru
Job Summary
Lead Azure Data Engineer with 5+ years of experience in designing and building scalable data lakes, data warehouses, and ETL pipelines using Azure Data Factory, Azure Databricks, SQL, and Python. Skilled in data modeling, Power BI reporting, Spark/PySpark, and delivering end-to-end data solutions in Agile environments.
Responsibilities
Develop, implement, and maintain the information data lake and using insight platforms to enable decision support systems for the overall organization. Partner with the business and our customers to understand their data and reporting requirements.
Bring data sets together to answer business questions and drive growth. Design ETLs to ingest the data into the data warehouse and data lake, as well as end-user facing reporting applications.
Collaborate with business customers and development teams to define requirements and deliver flexible, scalable, end-to-end solutions.
Work with new technologies while driving business intelligence solutions end-to-end: business requirements, data modelling, ETL, metadata, reporting, and dashboarding.
Apply expertise in the design, creation, management, and business use of large datasets.
Defines SLA for all areas of ownership.
Experience with Data modelling, SQL, ETL, Data Warehousing and Data lakes
Experience in writing SQL and Python scripts
Experience in building dashboards and report using Microsoft Power BI.
Preferred Qualifications
Experience in transforming data using Azure data factory
Experience working with Spark and Azure Databricks
Ability to balance and prioritize multiple conflicting requirements with high attention to detail.
Strong verbal/written communication & data presentation skills, including ability to succinctly summarize key findings and effectively communicate with both business and technical teams.
Familiarity of scripting language such as Python, PySpark, or JavaScript
Knowledge of Azure Databricks and MPP databases
Experience with Data Lake development
Exposure to NoSQL databases (such as Cosmos DB, MongoDB)
Experience working on Microsoft Power BI dashboards.
Experience following the Agile processes.
Experience working with distributed version control system like Git.
Experience with Mulesoft/Kingswaysoft/Marketo.
Experience: 5+ Years
Location: Gurugram, Pune, Hyderabad, Bengaluru
Job Summary
Lead Azure Data Engineer with 5+ years of experience in designing and building scalable data lakes, data warehouses, and ETL pipelines using Azure Data Factory, Azure Databricks, SQL, and Python. Skilled in data modeling, Power BI reporting, Spark/PySpark, and delivering end-to-end data solutions in Agile environments.
Responsibilities
Develop, implement, and maintain the information data lake and using insight platforms to enable decision support systems for the overall organization. Partner with the business and our customers to understand their data and reporting requirements.
Bring data sets together to answer business questions and drive growth. Design ETLs to ingest the data into the data warehouse and data lake, as well as end-user facing reporting applications.
Collaborate with business customers and development teams to define requirements and deliver flexible, scalable, end-to-end solutions.
Work with new technologies while driving business intelligence solutions end-to-end: business requirements, data modelling, ETL, metadata, reporting, and dashboarding.
Apply expertise in the design, creation, management, and business use of large datasets.
Defines SLA for all areas of ownership.
Experience with Data modelling, SQL, ETL, Data Warehousing and Data lakes
Experience in writing SQL and Python scripts
Experience in building dashboards and report using Microsoft Power BI.
Preferred Qualifications
Experience in transforming data using Azure data factory
Experience working with Spark and Azure Databricks
Ability to balance and prioritize multiple conflicting requirements with high attention to detail.
Strong verbal/written communication & data presentation skills, including ability to succinctly summarize key findings and effectively communicate with both business and technical teams.
Familiarity of scripting language such as Python, PySpark, or JavaScript
Knowledge of Azure Databricks and MPP databases
Experience with Data Lake development
Exposure to NoSQL databases (such as Cosmos DB, MongoDB)
Experience working on Microsoft Power BI dashboards.
Experience following the Agile processes.
Experience working with distributed version control system like Git.
Experience with Mulesoft/Kingswaysoft/Marketo.
More Info
Key Skills
Data Lakes
NoSQL databases
Kingswaysoft
About Company
Skills:
data engineering , Pyspark, Data Modeling, Databricks, Azure, Python, Sql
Skills:
Git, Sql, Azure Databricks, Kubernetes, Python, Terraform, Jenkins, Scala, Spark, Airflow