Databricks Architect

Key Responsibilities:

• Solution Design & Architecture: Design and implement end-to-end data architectures and pipelines on IICS and Databricks.
• Data Engineering & Development:
• Develop ETL/ELT processes for ingesting, transforming, and loading data from diverse sources.
• Platform Management: Configure, monitor, and manage Databricks clusters. Ensure compliance with data governance, security, and privacy regulations.
• Best Practices & Innovation: Stay updated with the latest features of IICS and Databricks, adopting industry best practices and innovative solutions.
• Collaboration & Leadership: Work closely with business stakeholders and cross-functional teams. Provide guidance, resolve technical challenges, and lead initiatives for data optimization.

Required Skills & Qualifications:

• Technical Skills: Proficiency in IICS, Databricks, Python, Scala, SQL, cloud platforms (Azure, AWS, GCP), data warehousing, ETL/ELT pipelines, and big data processing.
• Soft Skills: Strong analytical and problem-solving abilities, excellent communication, stakeholder management, and ability to work independently and lead teams.