Assist in the administration, configuration, and maintenance of Databricks clusters and workspaces.
Monitor Databricks clusters for high workloads or excessive usage costs, and promptly alert relevant stakeholders to address issues impacting overall cluster health.
Implement and manage security protocols, including access controls and data encryption, to safeguard sensitive information in adherence with Mastercard standards.
Facilitate the integration of various data sources into Databricks, ensuring seamless data flow and consistency.
Identify and resolve issues related to Databricks infrastructure, providing timely support to users and stakeholders.
Assist in development of MLOps solutions, namely within the scope of, but not limited to:
Model monitoring
Feature catalog/store
Model lineage maintenance
CI/CD pipelines to gatekeep model lifecycle from development to production
Maintain services once they are live by measuring and monitoring availability, latency and overall system health.
What experience you need:
Master s degree in computer science, software engineering, or a similar field.
Strong experience with Databricks and its management of roles and resources
Experience with MLOps solutions like MLFlow
Experience with performing data analysis, data observability, data ingestion and data integration.
2+ DevOps, SRE, or general systems engineering experience.
2+ years of hands-on experience in industry standard CI/CD tools like Git/BitBucket, Jenkins, Maven, Artifactory, and Chef.
Strong coding ability in Python or other languages like Java, and C++, plus a solid grasp of SQL fundamentals
Systematic problem-solving approach, coupled with strong communication skills
What could set you apart
SQL tuning experience.
Strong automation experience
Ability to operate in a 24x7 environment encompassing global time zones
Dynamic Yield by Mastercard enables teams to build personalized, optimized, and synchronized digital customer experiences, enhancing revenue and customer loyalty.