xiaonan.co

Xiao Nan
/ Shawn

Applied AI · ML Systems · Product

Selected projects

All projects

Interactive explainer

How an LLM generates a response

Follow one prompt through request routing, prefill, and the decode loop. Watch the KV cache grow as the server streams the answer.

  • LLM serving
  • Inference

Selected writing

All writing

Current interests