Job Description
Design and develop scalable ETL pipelines using Databricks, PySpark, and SQL.
Hands-on experience with data lake architectures, and cloud platforms like Azure. (If there is a preference, please specify, else assumption is that the candidate would need Azure experience)
Optimize large-scale data workflows with a focus on performance, quality, and reliability.
Experience with CI/CD pipelines, Git, and orchestration tools like Azure Data Factory.
Strong understanding of data modeling, warehousing concepts, and production support.