- Solid understanding of data pipeline architecture, cloud infrastructure, and best practices in data engineering.
- Databricks , ADF & SQL are mandatory to have
- Excellent problem-solving skills and attention to detail.
- Ability to work independently and collaborate effectively in a team environment.
- Skilled in independently analyzing large datasets, identifying discrepancies and inconsistencies, and recommending corrective actions.
- Demonstrated expertise in working with SQL Server, Oracle, Azure SQL Databases, and APIs.
- Experience with at least one programming language (Python).
- Hands-on experience with Azure Data Factory (ADF), Logic Apps, and Runbooks.
- Familiarity with the Azure cloud platform and PowerShell scripting.
- Strong problem-solving and analytical skills.
- Excellent communication and teamwork abilities, with experience engaging stakeholders at all levels.
- Capable of managing and adjusting to evolving priorities from multiple projects.
SQL,Python,Apache Spark,Data Bricks,Azure Data Factory,SQL Server,Azure SQL Database,ETL,Powershell Scripting
Senior Data Engineer - Azure & Databricks
Development and maintenance of Data Pipelines, Modernisation of cloud data platform
- At least 8 years experience in Data Engineering space
- At least 4 experiences in Apache Spark/ Databricks
- At least 4 years of experience in Python & at least 7 years in SQL and ETL stack.