We are seeking a highly skilled Data Engineer with a minimum of 3 - 4 years of data engineering experience to join our dynamic team. The ideal candidate will have a strong background in data engineering technologies, especially SQL, Databricks, PySpark, and Azure Data Engineering Services and client-facing experience
Requirements
- Mandatory skills: Python/PySpark, SQL/Spark SQL, Spark, Databricks, Azure Data Factory.
- Strong ETL background.
- Certification in Databricks Certified DE Associate/Professional.
- Minimum of 4 years experience in the Databricks platform.
- Good to have skills: Azure DE Services (Synapse, Fabric), AWS DE Services (Glue), Data Modelling, any BI tools (Power BI, Tableau, Qlik, Looker).
Technical Expertise
- Hands-on experience with SQL (Fundamental queries to advanced joins, functions, data transformation), Databricks (Delta Lake, Unity Catalogue, DLT framework, Mosaic AI), PySpark, Python, Azure Cloud, Design, develop, and optimise PySpark workloads.
- Ability to write scalable, modular, and reusable code in SQL, Python, and PySpark.
Others
- Engage with stakeholders to gather and analyse requirements.
- Provide regular updates and reports on project status and progress.
- Ensure alignment of data solutions with business objectives.
- 4 years of experience in data engineering or related fields.
- Strong communication skills, both written and verbal.
- Strong problem-solving skills and attention to detail.
- Machine learning exposure is a plus.
This job was posted by Akshay Patil from Netscribes.
