Databricks Admin

Pradeepit Consulting Services is seeking a highly skilled Databricks Admin to join our dynamic team. This pivotal role requires strong expertise in Databricks administration, coupled with a solid understanding of AWS infrastructure and data warehousing concepts. You'll be responsible for managing Databricks clusters, ensuring seamless deployments, providing critical support to our analyst community, and troubleshooting complex issues within the Databricks environment.

Key Responsibilities

• Databricks Infrastructure Management: Manage and optimize Databricks clusters at scale, ensuring high availability and performance.
• Deployment & Configuration: Oversee deployments within Databricks and work with Databricks System tables for monitoring and management.
• Troubleshooting & Support: Provide strong troubleshooting capabilities for issues within Databricks notebooks and address Databricks-related queries from the analyst community.
• Cloud & Data Platform Fundamentals: Apply good knowledge of AWS services and strong fundamentals of Data Warehousing (DW) / Data Lakehouse (DH) concepts.
• Coding & Automation: Utilize Spark/Python for scripting and automation within the Databricks environment.
• Containerization & Orchestration: Work with Docker and Kubernetes.
• AWS Services Integration: Leverage knowledge of relevant AWS services such as S3, Lambda, and EMR.

Required Skills

• Good knowledge of AWS, Databricks, and Unity Catalog.
• Strong experience in managing Databricks clusters and deployments.
• Strong fundamentals of Data Warehousing (DW) / Data Lakehouse (DH) concepts.
• Strong troubleshooting abilities within the Databricks environment.
• Proficiency in Spark/Python (either coding skills).
• Experience with Docker, Kubernetes, and AWS services (S3, Lambda, EMR).
• Expertise in managing clusters at scale and troubleshooting within Databricks.
• Experience working with Databricks System tables.
• Strong knowledge of Databricks infrastructure and administration to support the Analyst community in addressing Databricks-related queries and troubleshooting issues in notebooks.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related field.
• Proven experience as a Databricks Admin or in a similar role.
• Typically seeking candidates with 6+ years of relevant experience.
• Certified Databricks Engineer is required.