Tag: llm-ops
All the articles with the tag "llm-ops".
-
Intro to LLMs: The Whole Picture in One Post
A standalone map of large language models for beginners: how they evolved, how they are trained, how prompts and context windows work, how to pick one, and how to tell if the output is any good.
-
How We Cut ML Inference Latency by 40% on Kubernetes
The architecture behind our async model serving platform at Instabase — async workers, RabbitMQ, multi-level caching, and sticky routing to cut inference time by 40%.