Serve Your Own LLM: vLLM & SGLang, End-to-End

Vizuara
7,538,345 views •

Details and enrolment: https://vllm-sglang.vizuara.ai vLLM & SGLang Engineering: End-to-End, a new live bootcamp by Dr. Sreedath Panat (PhD, MIT; co-founder, Vizuara AI Labs). Outside a handful of frontier labs, almost every open-source model you use (Llama, Mistral, Kimi, DeepSeek, Gemma) is served by vLLM or SGLang. This bootcamp teaches you to run them in practice: - Trace a request from the chat window to the GPU and back - Build a benchmark harness for latency and throughput - Tune memory, batching, prefix caching, quantization, multi-GPU and mixture-of-experts serving - Production: routers, Kubernetes, metrics and cost per token - Capstone: serve one model on both engines, measure, evaluate, and decide which one ships 12 live lectures. Starts November 2026.

Keyboard shortcuts

On. Switch them off if they collide with your assistive tools; ? still opens this sheet.

Go to

Press g then the letter.

  • gh Latest
  • gs Sources
  • gm Media
  • gv Videos
  • gp Podcasts
  • gc Calendar
  • gd Decoder
  • gz Dataviz
  • ga Datasets
  • gb Blog
  • gk Markets
  • gj Careers
  • gn Prompt Notebook

On this page

  • / Focus search, where there is one
  • t Back to top
  • ? This list
  • Esc Close