Dynamic Yield, a Mastercard company, is committed to connecting and powering an inclusive, digital economy that benefits everyone. Our SSO Data Science team, specifically the Horizontal Data Science Enablement Team, is seeking a Senior MLOps Engineer. This role is crucial for solving complex MLOps problems, managing our organization's Databricks platform, building robust CI/CD and automation pipelines, and championing best practices.
If you're passionate about optimizing the machine learning lifecycle and ensuring platform stability, we encourage you to join our team and contribute to cutting-edge data science enablement.
All About You
As a Senior MLOps Engineer, you will:
- Databricks Platform Management:Assist in the administration, configuration, and maintenance of Databricks clusters and workspaces.
- Monitor Databricks clusters for high workloads or excessive usage costs, and promptly alert relevant stakeholders to address issues impacting overall cluster health.
- Implement and manage security protocols, including access controls and data encryption, to safeguard sensitive information in adherence with Mastercard standards.
- Facilitate the integration of various data sources into Databricks, ensuring seamless data flow and consistency.
- Identify and resolve issues related to Databricks infrastructure, providing timely support to users and stakeholders.
- MLOps Solution Development:Assist in the development of MLOps solutions, including but not limited to:
- Model monitoring
- Feature catalog/store
- Model lineage maintenance
- CI/CD pipelines to gatekeep model lifecycle from development to production.
- Operational Excellence:Maintain services once they are live by measuring and monitoring availability, latency, and overall system health.
- Apply a systematic problem-solving approach to all challenges.
What Experience You Need
- Education: Master's degree in computer science, software engineering, or a similar field.
- Databricks Expertise: Strong experience with Databricks and its management of roles and resources.
- MLOps Tools: Experience with MLOps solutions like MLFlow.
- Data Skills: Experience with performing data analysis, data observability, data ingestion, and data integration.
- DevOps/SRE Background:2+ years of DevOps, SRE, or general systems engineering experience.
- CI/CD Proficiency:2+ years of hands-on experience in industry-standard CI/CD tools like Git/BitBucket, Jenkins, Maven, Artifactory, and Chef.
- Programming: Strong coding ability in Python or other languages like Java and C++, plus a solid grasp of SQL fundamentals.
- Communication: Strong communication skills (both written and verbal).
What Could Set You Apart
- SQL Tuning: Experience with SQL tuning.
- Automation: Strong automation experience.
- Global Operations: Ability to operate in a 24x7 environment encompassing global time zones.
