Start here

Articles

Article48 min read

Writing Kubernetes Controllers

Learn how Kubernetes controllers work, from watches and queues to reconciliation, scaling, testing, and production use.

Article12 min read

Prefill and Decode Need Different Resources

Prefill processes the prompt. Decode generates one token at a time. Learn when running them on separate workers improves speed and capacity—and when it does not.

Build it yourself

Guides

Apply the ideas

System designs