Why Prefill and Decode Should Not Share a GPU
A systems-oriented introduction to Prefill-Decode disaggregation in LLM inference, from KV cache physics and roofline intuition to vLLM and SGLang implementation trade-offs.
#inference
Content tagged with "inference"