Technical Architect

KPI Partners is seeking a talented Databricks Architect to join our dynamic team. The ideal candidate will have extensive experience with Databricks and a strong proficiency in SQL, PySpark, Azure, and Python. This role involves designing and implementing data solutions on the Databricks platform that meet our clients needs.

Key Responsibilities:

- Design and develop scalable data pipelines using Databricks.

- Collaborate with data scientists and engineers to build robust data architectures.

- Utilize SQL and PySpark for data manipulation and analysis.

- Implement best practices in data governance and security in Azure environments.

- Optimize existing data workflows for improved efficiency and performance.

- Provide technical guidance and support to internal teams and clients.

- Stay updated on the latest Databricks features and industry trends to enhance solutions.

Required Skills and Qualifications:

- Strong expertise in Databricks and its ecosystem.

- Proficient in SQL and PySpark for data processing and analysis.

- Experience with Azure cloud services and their integration with Databricks.

- Solid understanding of Python for data engineering tasks.

- Excellent problem-solving skills and the ability to work collaboratively.

- Strong communication skills to effectively interact with clients and team members.