Support new AI models on day zero with vLLM

Red Hat
943 views •

The most important enterprise infrastructure has always been open source, and AI inference is no exception. Red Hat CTO for AI Brian Stevens explains how vLLM provides day-zero model support and open collaboration across accelerators! #vLLM #RedHat #OpenSource #AIInference #EnterpriseAI ➡️ See how open source gives you full control over model scaling: https://red.ht/future-of-inference

Keyboard shortcuts

On. Switch them off if they collide with your assistive tools; ? still opens this sheet.

Go to

Press g then the letter.

  • gh Latest
  • gs Sources
  • gm Media
  • gv Videos
  • gp Podcasts
  • gc Calendar
  • gd Decoder
  • gz Dataviz
  • ga Datasets
  • gb Blog
  • gk Markets
  • gj Careers
  • gn Prompt Notebook

On this page

  • / Focus search, where there is one
  • t Back to top
  • ? This list
  • Esc Close