Cascade vs. speech-to-speech vs. full-duplex voice agents

LiveKit
34,707 views •

There's more than one way to build a voice agent, and each one has trade-offs. A cascade chains speech-to-text, an LLM, and text-to-speech, so you can pick the best model for each stage. LiveKit's turn detection knows when you've finished, ignores an "uh-huh", and stops when you cut in. Turn-based speech-to-speech uses one model that hears your tone and replies in its own voice, with less delay. Full-duplex speech-to-speech listens while it talks, so it can backchannel while you speak. The best way to choose is to try them. LiveKit Inference now runs all three with one API key, one bill, and zero data retention. Switching is a small change to your AgentSession, and your agent logic stays the same, in Python and Node.js. Get started: https://cloud.livekit.io/signup?utm_source=youtube&utm_medium=video&utm_campaign=devrel&utm_content=BZaWD9QPCME šŸ“š Resources šŸ“š Agent docs: https://docs.livekit.io/agents/?utm_source=youtube&utm_medium=video&utm_campaign=devrel&utm_content=BZaWD9QPCME šŸ¤ Join the Community: https://community.livekit.io/?utm_source=youtube&utm_medium=video&utm_campaign=devrel&utm_content=BZaWD9QPCME #livekit #ai #voiceai

Keyboard shortcuts

On. Switch them off if they collide with your assistive tools; ? still opens this sheet.

Go to

Press g then the letter.

  • gh Latest
  • gs Sources
  • gm Media
  • gv Videos
  • gp Podcasts
  • gc Calendar
  • gd Decoder
  • gz Dataviz
  • ga Datasets
  • gb Blog
  • gk Markets
  • gj Careers
  • gn Prompt Notebook

On this page

  • / Focus search, where there is one
  • t Back to top
  • ? This list
  • Esc Close