Serve Your Own LLM with vLLM & SGLang | Live Bootcamp on Maven
Join the live bootcamp on Maven: https://maven.com/rajat-dandekar/vllm-sglang-engineering Use code VLLMSGLANG for 10% off at checkout. Starts November 11. vLLM & SGLang Engineering: End-to-End, a live bootcamp by Dr. Sreedath Panat (PhD, MIT; IIT Madras; co-founder, Vizuara AI Labs). Every time an AI model, a chatbot or a coding agent answers you, somebody is paying for it. Whether an AI product makes money comes down to how cheaply and how fast you can serve it. Outside a handful of frontier labs, that serving almost always runs on two open-source engines: vLLM and SGLang. In 12 live sessions you will: - Serve your own LLM or SLM end to end - Pick a model and serve it on both engines - Measure and evaluate it - Decide which engine to ship for your application An inference course teaches what makes inference fast. This bootcamp is about how you do it in practice. Enroll: https://maven.com/rajat-dandekar/vllm-sglang-engineering