We are seeking expert Azure Data Engineers proficient in ADF, Azure Databricks, PySpark, and Python to design and optimize scalable cloud data solutions. Join our IT staffing team to deliver enterprise-grade data pipelines, ETL processes, and analytics platforms for leading clients across industries.
Role Summary
As an Azure Data Engineer, you'll architect robust data solutions using Azure Data Factory, Azure Databricks, and Synapse. With 5+ years of experience handling large-scale SQL data marts and cloud connectivity, you'll drive data extraction, transformation, and analytics for business-critical applications.
Key Responsibilities
Required Technical Skill Set: Azure Data Engineer, ADF, Azure Databricks Spark (PySpark or Scala), Python, PL/SQL.
Desired Competencies
- Strong experience in Azure Data Factory, Azure Databricks (ADB), Synapse, PySpark; establishing cloud connectivity between systems like ADLS, ADF, Synapse, Databricks.
- Minimum 5 years experience with large SQL data marts; expert relational database skills with ability to navigate massive data volumes for efficient extraction, design, load, and reporting solutions.
- Minimum 5 years troubleshooting/supporting large databases, testing activities; identifying/managing database security, user access; designing backup/archiving/storage, performance tuning, ETL for large data volumes, capacity planning.
- Experience in T-SQL programming with Azure Data Factory framework and Python scripting.
Required Skills- Core Technical Skills:
- Azure Data Factory (ADF) pipeline development and orchestration
- Azure Databricks (Spark - PySpark/Scala) for data processing
- Azure Synapse Analytics integration
- Python scripting for data transformation/automation
- PL/SQL and T-SQL programming
- ADLS, cloud connectivity across Azure services
Skills: data,sql,data marts,python,data solutions,cloud,analytics,azure
