Serve Your Own LLM with vLLM & SGLang | Live Bootcamp on Maven

Vizuara
934,013 views •

Join the live bootcamp on Maven: https://maven.com/rajat-dandekar/vllm-sglang-engineering Use code VLLMSGLANG for 10% off at checkout. Starts November 11. vLLM & SGLang Engineering: End-to-End, a live bootcamp by Dr. Sreedath Panat (PhD, MIT; IIT Madras; co-founder, Vizuara AI Labs). Every time an AI model, a chatbot or a coding agent answers you, somebody is paying for it. Whether an AI product makes money comes down to how cheaply and how fast you can serve it. Outside a handful of frontier labs, that serving almost always runs on two open-source engines: vLLM and SGLang. In 12 live sessions you will: - Serve your own LLM or SLM end to end - Pick a model and serve it on both engines - Measure and evaluate it - Decide which engine to ship for your application An inference course teaches what makes inference fast. This bootcamp is about how you do it in practice. Enroll: https://maven.com/rajat-dandekar/vllm-sglang-engineering

Keyboard shortcuts

On. Switch them off if they collide with your assistive tools; ? still opens this sheet.

Go to

Press g then the letter.

  • gh Latest
  • gs Sources
  • gm Media
  • gv Videos
  • gp Podcasts
  • gc Calendar
  • gd Decoder
  • gz Dataviz
  • ga Datasets
  • gb Blog
  • gk Markets
  • gj Careers
  • gn Prompt Notebook

On this page

  • / Focus search, where there is one
  • t Back to top
  • ? This list
  • Esc Close