A
Azure Data Engineer ( Azure Databricks)
Job Description
Key Responsibilities
- Design, develop, and optimize large-scale data pipelines using Azure Data Factory, Azure Databricks, and Azure Synapse.
- Implement data lake solutions and work with structured and unstructured datasets in Azure Data Lake Storage (ADLS).
- Collaborate with data scientists, analysts, and engineering teams to design and deliver end-to-end data solutions.
- Develop ETL/ELT processes and integrate data from multiple sources.
- Monitor, debug, and optimize workflows for performance and cost-efficiency.
- Ensure data governance, quality, and security best practices are maintained.
Must-Have Skills
- 4+ years of total experience in data engineering.
- 2+ years of experience with Azure Databricks (PySpark, Notebooks, Delta Lake).
- Strong experience with Azure Data Factory, Azure SQL, and ADLS.
- Proficient in writing SQL queries and Python/Scala scripting.
- Understanding of CI/CD pipelines and version control systems (e.g., Git).
- Solid grasp of data modeling and warehousing concepts.
More Info
Job Type:
Industry:
Function:
Employment Type:
Key Skills
About Company
We are team of experienced technology solutions with decades of industry experience. With our in-depth understanding of business lifecycle and digital technologies, we successfully collaborate with our client to fulfill their talent needs. With deep focus for digital product development skills to Cloud, Data, DevOps and Automation, our team is comprised of technical talent hunters.
Skills:
Azure Data Factory, Scala, Data Warehousing, Azure Databricks, Data Modeling, Sql, Python, Palantir, ETL processes
Skills:
Azure Databricks, Data Modeling, SQL Server, Data Warehousing, Python Scripting, Cloud Solutions, Data Governance, Performance Tuning, ETL Processes, Spark Programming