Azure Data Engineer

Job Description

KPI Partners is seeking a highly skilled and experienced Sr Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering, with expertise in Python Pandas, Databricks, Azure Data Factory (ADF), and DevOps practices.

Key Responsibilities:

- Design, develop, and implement robust data pipelines using Python Pandas and Databricks to ingest, process, and analyze large datasets.

- Collaborate with cross-functional teams to gather requirements and ensure data solutions meet business needs.

- Utilize Azure Data Factory to orchestrate data workflows and integrate data from various sources.

- Implement best practices for data governance, quality, and security throughout the data lifecycle.

- Develop and maintain automated deployment pipelines using DevOps tools to streamline the development process.

- Monitor and optimize data processes for performance and reliability.

- Troubleshoot and resolve data-related issues efficiently.

- Stay up-to-date with industry trends and emerging technologies to continually improve data engineering practices.

Qualifications:

- Bachelor's degree in Computer Science, Engineering, or a related field.

- Minimum of [insert years] years of experience in data engineering roles.

- Proficiency in Python, with strong experience in using Pandas for data manipulation and analysis.

- Hands-on experience with Databricks and Azure Data Factory.

- Familiarity with DevOps practices and tools.

- Strong problem-solving skills and analytical mindset.- Excellent communication and collaboration abilities.

Why Join KPI Partners:

- Opportunity to work on cutting-edge data engineering projects.

- Collaborative and innovative work environment.

- Competitive salary and benefits package.

- Opportunities for professional growth and development.

If you are passionate about data engineering and possess the required skills and experience, we encourage you to apply for the Sr Data Engineer position at KPI Partners.