MLOps & Infrastructure · intermediate · concept 212 of 311 · Updated Nov 4, 2026
LLMOps
LLMOps is the practice of running language model applications in production: versioning prompts, evaluating every change, tracing what happened, watching costs and catching regressions. It extends MLOps, but the main artifact is usually a prompt and a chain of calls rather than a model you trained. Most production failures come from weak evaluation, not weak models.
L8 · Production and scaleDevelopersTech leadersLeadershipProduct leadersQA and testingSEO and content
Top AI contributors on this
- Jensen HuangNvidia
- Jeff DeanDiscovery Loop
- Clément DelangueHugging Face
- Satya NadellaMicrosoft
- Sundar PichaiAlphabet / Google
- Alexandr WangMeta
Key terms
Prompt versioningTracingEvaluationCost monitoringRegression testing
Learn these first
Where you meet it in the real world
Running chat assistants, RAG products and agents reliably at scale
Guides and articles
What we learned from a year of building with LLMs ↗
Eugene Yan and others