Serve Your Own LLM: vLLM & SGLang, End-to-End
Details and enrolment: https://vllm-sglang.vizuara.ai vLLM & SGLang Engineering: End-to-End, a new live bootcamp by Dr. Sreedath Panat (PhD, MIT; co-founder, Vizuara AI Labs). Outside a handful of frontier labs, almost every open-source model you use (Llama, Mistral, Kimi, DeepSeek, Gemma) is served by vLLM or SGLang. This bootcamp teaches you to run them in practice: - Trace a request from the chat window to the GPU and back - Build a benchmark harness for latency and throughput - Tune memory, batching, prefix caching, quantization, multi-GPU and mixture-of-experts serving - Production: routers, Kubernetes, metrics and cost per token - Capstone: serve one model on both engines, measure, evaluate, and decide which one ships 12 live lectures. Starts November 2026.