Software Platform Engineer II
Job Description
- Design and implement production APIs and microservices in Python (FastAPI, async I/O).
- Build agentic AI workflows and the surrounding harness with LangGraph/LangChain — tool calling,
- Ship and operate production agents on frontier models (Claude, GPT, Gemini); optimize for latency,
- Package, serve, version, and optimize ML/LLM models for low‑latency and batch/async inference
- Implement LLM features: embeddings, retrieval‑augmented generation (RAG), vector search, and prompt
- Build resilient event‑driven integrations (Event Hubs/Kafka patterns), idempotent consumers, and
- Containerize services (Docker), author manifests/Helm charts, and debug Kubernetes (AKS) workloads.
- Instrument services and models (logging, metrics, tracing), define SLOs, and lead incident triage
- Deliver automated tests and CI/CD for services and model pipelines; collaborate on release gating
- Partner with frontend (React/Next.js/TypeScript) to deliver end‑to‑end AI features.
More Info
Key Skills
LangChain
embeddings
vector search
MLflow
AKS
context engineering
LangSmith
LangGraph
Helm charts
Next.js
Event Hubs
async I/O
