Agents are slower than LLMs?

Caleb Writes Code
14,423 views •

Back to School Tech Deals: https://micro.center/124b83 Sign up for a FREE 128 gig Flash Drive at Micro Center Austin, TX: https://micro.center/36b811 Sign up for a FREE 128 gig Flash Drive at Micro Center Columbus, OH: https://micro.center/e9c4ab Visit Micro Center News: https://micro.center/bedd4e Factors that play into why agents are slow compared to LLMs. We look at the entire AI stack going from Application and Agents to Model, to Infrastructure, to Chip, to Energy and see how ReAct and agentic tool calls impact the speed and efficiency of the agent. Claude Code, Codex, Pi, and OpenCode are all harnessing that also affect the speed and efficacy of the model as well. Follow me: X: https://x.com/calebfoundry LinkedIn: https://www.linkedin.com/in/calebeom/ TikTok: https://www.tiktok.com/@calebwritescode Chapters 00:00 Intro 00:20 Agents 00:40 Tools 02:05 GPU 03:06 Disagg Inference 04:48 Caching 05:02 Local Agents 05:52 Sponsor: Micro Center 07:01 Energy 08:27 Harness 09:23 Use Cases 09:47 Model

Keyboard shortcuts

On. Switch them off if they collide with your assistive tools; ? still opens this sheet.

Go to

Press g then the letter.

  • gh Latest
  • gs Sources
  • gm Media
  • gv Videos
  • gp Podcasts
  • gc Calendar
  • gd Decoder
  • gz Dataviz
  • ga Datasets
  • gb Blog
  • gk Markets
  • gj Careers
  • gn Prompt Notebook

On this page

  • / Focus search, where there is one
  • t Back to top
  • ? This list
  • Esc Close