Databricks Admin

Job Description:

• We are looking for a skilled Databricks Administrator to manage maintain and optimize the Databricks platform within our data ecosystem
• The ideal candidate will have hands on experience with Databricks workspace administration cluster management security and performance optimization ensuring efficient big data processing and analytics

Key Responsibilities:

• Administer and manage Azure AWS Databricks workspaces
• Configure and maintain clusters including creation scaling and optimization
• Manage user access roles and permissions using RBAC and integration with identity providers Azure AD etc
• Monitor cluster performance and optimize cost resource utilization and job execution
• Implement and manage job scheduling workflows and pipelines
• Ensure data security and governance including data encryption and access policies
• Integrate Databricks with data sources such as ADLS S3 Snowflake or SQL databases
• Troubleshoot issues related to jobs clusters notebooks and integrations
• Support CI CD pipelines and DevOps processes for Databricks deployments
• Monitor usage through logs metrics and audit trails
• Maintain documentation for architecture configurations and processes
• Collaborate with data engineers data scientists and DevOps teams

Technical Requirements:

• 2 5 years of experience in Databricks Administration Big Data Platforms
• Strong hands on experience with Databricks Workspace Clusters Jobs Notebooks
• Experience with Apache Spark PySpark Scala and distributed data processing
• Knowledge of cloud platforms Azure preferred AWS GCP also acceptable
• Experience with data storage systems like ADLS S3 Blob Storage
• Good understanding of data engineering concepts ETL ELT pipelines
• Familiarity with security best practices IAM roles data encryption private endpoints
• Proficiency in SQL and scripting languages Python Shell etc
• Experience in performance tuning and cost optimization for clusters and workloads

Additional Responsibilities:

• Infosys is a global leader in next generation digital services and consulting
• We enable clients in more than 50 countries to navigate their digital transformation
• With over four decades of experience in managing the systems and workings of global enterprises we expertly steer our clients through their digital journey
• We do it by enabling the enterprise with an AI powered core that helps prioritize the execution of change
• We also empower the business with agile digital at scale to deliver unprecedented levels of performance and customer delight
• Our always on learning agenda drives their continuous improvement through building and transferring digital skills expertise and ideas from our innovation ecosystem
• Infosys provides equal employment opportunities to applicants and employees without regard to race color sex gender identity sexual orientation religious practices and observances national origin pregnancy childbirth or related medical conditions status as a protected veteran or spouse family member of a protected veteran or disability

Preferred Skills: