Qwen3-Next from Alibaba - next level local AI model?

AI Bites
501 views •

Alibaba has recently come up with improvements to Qwen3 and calls it Qwen3-Next. It uses very sparse Mixture of Experts and yet delivers super cool performance. The boost is performance mainly comes from leveraging Gated Attention and the novel Gated DeltaNet. So, in this video lets look into what makes Qwen3-Next special. RELATED LINKS Alibaba Blog - https://qwen.ai/blog?id=4074cca80393150c248e508aa62983f9cb7d27cd&from=research.latest-advancements-list Gated Delta Network - https://arxiv.org/abs/2412.06464 Gated Attention - https://arxiv.org/abs/2505.06708 AI BITES KEY LINKS Website: https://www.ai-bites.net YouTube: https://www.youtube.com/@AIBites Twitter: https://twitter.com/ai_bites​ Patreon: https://www.patreon.com/ai_bites​ Github: https://github.com/ai-bites​

Keyboard shortcuts

On. Switch them off if they collide with your assistive tools; ? still opens this sheet.

Go to

Press g then the letter.

  • gh Latest
  • gs Sources
  • gm Media
  • gv Videos
  • gp Podcasts
  • gc Calendar
  • gd Decoder
  • gz Dataviz
  • ga Datasets
  • gb Blog
  • gk Markets
  • gj Careers
  • gn Prompt Notebook

On this page

  • / Focus search, where there is one
  • t Back to top
  • ? This list
  • Esc Close