Data Engineer

We are seeking a skilled Data Engineer to join our dynamic team in Maharashtra. The ideal candidate will have a strong background in data engineering and analytics, with expertise in Azure Data Factory, Azure Databricks, and PySpark. As a Data Engineer, you will be responsible for designing, building, and maintaining data pipelines that support our data analytics and business intelligence initiatives. Key Responsibilities: - Develop and maintain scalable data pipelines using Azure Data Factory and Azure Databricks. - Utilize PySpark and Python for data processing and transformation tasks. - Collaborate with data analysts and business stakeholders to understand data requirements and deliver solutions that meet their needs. - Implement data storage solutions using Azure Data Lake Storage (ADLS) and ensure data integrity and security. - Create and optimize SQL queries for data retrieval and manipulation. - Develop reports and dashboards using Power BI and DAX to provide insights into business performance. - Monitor and troubleshoot data pipeline performance and resolve any issues that arise. Required Skills: - Proficiency in Azure Data Factory and Azure Databricks. - Strong programming skills in PySpark and Python. - Experience with data storage solutions, particularly Azure Data Lake Storage (ADLS). - Solid understanding of SQL for data manipulation and retrieval. - Familiarity with Power BI and DAX for reporting and visualization. - Excellent problem-solving skills and attention to detail. - Ability to work collaboratively in a team environment and communicate effectively with stakeholders. If you are passionate about data engineering and want to make a significant impact in a growing organization, we encourage you to apply for this exciting opportunity.

This job is provided by Shine.com