LLM & ML Ops Engineer

Gainwell Technologies LLC

Remote

4-9 Years

This job is no longer accepting applications

Posted 2 months ago
Over 50 applicants

Job Description

Gainwell is seeking LLM Ops Engineers and ML Ops Engineers to join our growing AI/ML team.
This role is responsible for developing, deploying, and maintaining scalable infrastructure and pipelines for Machine Learning (ML) models and Large Language Models (LLMs). You will play a critical role in ensuring smooth model lifecycle management, performance monitoring, version control, and compliance while collaborating closely with Data Scientists, DevOps.
Summary
Gainwell is seeking LLM Ops Engineers and ML Ops Engineers to join our growing AI/ML team. This role is responsible for developing, deploying, and maintaining scalable infrastructure and pipelines for Machine Learning (ML) models and Large Language Models (LLMs). You will play a critical role in ensuring smooth model lifecycle management, performance monitoring, version control, and compliance while collaborating closely with Data Scientists, DevOps.
Your role in our mission
Core LLM Ops Responsibilities:
Develop and manage scalable deployment strategies specifically tailored for LLMs (GPT, Llama, Claude, etc.).
Optimize LLM inference performance, including model parallelization, quantization, pruning, and fine-tuning pipelines.
Integrate prompt management, version control, and retrieval-augmented generation (RAG) pipelines.
Manage vector databases, embedding stores, and document stores used in conjunction with LLMs.
Monitor hallucination rates, token usage, and overall cost optimization for LLM APIs or on-prem deployments.
Continuously monitor models for its performance and ensure alert system in place.
Ensure compliance with ethical AI practices, privacy regulations, and responsible AI guidelines in LLM workflows.
Core ML Ops Responsibilities:
Design, build, and maintain robust CI/CD pipelines for ML model training, validation, deployment, and monitoring.
Implement version control, model registry, and reproducibility strategies for ML models.
Automate data ingestion, feature engineering, and model retraining workflows.
Monitor model performance, drift, and ensure proper alerting systems are in place.
Implement security, compliance, and governance protocols for model deployment.
Collaborate with Data Scientists to streamline model development and experimentation.
What we're looking for
Bachelor's/Master's degree in computer science, Engineering, or related fields.
Strong experience with ML Ops tools (Kubeflow, MLflow, TFX, SageMaker, etc.).
Experience with LLM-specific tools and frameworks (LangChain, Lang Graph, LlamaIndex, Hugging Face, OpenAI APIs, Vector DBs like Pinecone, FAISS, Weavite, Chroma DB etc.).
Solid experience in deploying models in cloud (AWS, Azure, GCP) and on-prem environments.
Proficient in containerization (Docker, Kubernetes) and CI/CD practices.
Familiarity with monitoring tools like Prometheus, Grafana, and ML observability platforms.
Strong coding skills in Python, Bash, and familiarity with infrastructure-as-code tools (Terraform, Helm, etc.).
Knowledge of healthcare AI applications and regulatory compliance (HIPAA, CMS) is a plus.
Strong skills in Giskard, Deepeval etc.
What you should expect in this role
Fully Remote Opportunity Work from anywhere in the India
Minimal Travel Required Occasional travel opportunities (0-10%)
Opportunity to Work on Cutting-Edge AI Solutions in a mission-driven healthcare technology environment
Role Description
Core LLM Ops Responsibilities:
Develop and manage scalable deployment strategies specifically tailored for LLMs (GPT, Llama, Claude, etc.).
Optimize LLM inference performance, including model parallelization, quantization, pruning, and fine-tuning pipelines.
Integrate prompt management, version control, and retrieval-augmented generation (RAG) pipelines.
Manage vector databases, embedding stores, and document stores used in conjunction with LLMs.
Monitor hallucination rates, token usage, and overall cost optimization for LLM APIs or on-prem deployments.
Continuously monitor models for its performance and ensure alert system in place.
Ensure compliance with ethical AI practices, privacy regulations, and responsible AI guidelines in LLM workflows.
Core ML Ops Responsibilities:
Design, build, and maintain robust CI/CD pipelines for ML model training, validation, deployment, and monitoring.
Implement version control, model registry, and reproducibility strategies for ML models.
Automate data ingestion, feature engineering, and model retraining workflows.
Monitor model performance, drift, and ensure proper alerting systems are in place.
Implement security, compliance, and governance protocols for model deployment.
Collaborate with Data Scientists to streamline model development and experimentation.

More Info

Job Type:

Permanent Job, Work From Home

Industry:

Information Services

Role:

Other Analytics /Business Intelligence, Data Analyst

Function:

Analytics/Business Intelligence

Employment Type:

Full time

Open to candidates from:

Indian

About Company

Gainwell Technologies LLC

Gainwell Technologies is the leading provider of technology solutions that are vital to the administration and operations of health and human services programs. We are the key player in the Medicaid space with a presence in 51 of the 56 U.S. states and territories with offerings including Medicaid Management Information Systems (MMIS),

Fiscal Agent Services, Program Integrity, Care Management, Immunization Registry, and Eligibility Services.

We generate over $2 billion in annual revenue, and we’ve been innovating in the industry for more than 50 years. Powered by more than 14,000 employees, Gainwell solutions support more than 60 million Medicaid beneficiaries nationwide and manage 1 billion encounters annually. Additionally, about 1.5 billion immunization records are maintained, and we serve more than 3 million providers annually.

We do this while saving our state and commercial clients 5.5 billion dollars annually in cost avoidance.
Our commitment to clients drives continuous improvement in the quality of healthcare for beneficiaries nationwide through vital healthcare technology.
In summary, there’s no company better positioned in the Medicaid and HHS (Health and Human Services) market than Gainwell.

Job ID: 111325679

Jobs by Skill - IT