Switchyard NVIDIA's Local Agent Router
NeMo Switchyard is the newest open source library from NVIDIA. Its goal is to be the router that picks the right model for each step of an agent run. Blog: https://developer.nvidia.com/blog/route-ai-agent-workloads-across-models-with-nvidia-nemo-switchyard?ncid=ref-inor-845739 Twitter: https://x.com/Sam_Witteveen 🕵️ Interested in building LLM Agents? Fill out the form below Building LLM Agents Form: https://drp.li/dIMes 👨💻Github: https://github.com/samwit/llm-tutorials ⏱️Time Stamps: 00:00 Intro 00:21 Router Workflow 00:50 NVIDIA Switchyard 01:11 Problems encountered in long-running Agents 02:30 Switchyard: Faster Response and Token Efficiency 02:56 Switchyard is Open Source 03:10 Switchyard Architecture 03:35 Wire Formats 04:52 Built-in Observability 05:12 Routing Algorithms 08:26 Takeaways