VLA on Raspberry Pi?

Hardware.ai
626 views •

I'm GPU-poor and I'm not ashamed to admit it. I took @HuggingFace SmolVLA, a 500M-parameter robot model people normally run on GPUs, and squeezed it onto boards that don't cost a metaphorical arm and a leg. 60 seconds of inference per action chunk down to 1.7 seconds, real-time on Radxa Orion O6. Almost the same time (1.8 seconds) on @raspberrypi Pi 5. Sources and Links: https://huggingface.co/blog/smolvla https://huggingface.co/HuggingFaceVLA/smolvla_libero https://github.com/VinRobotics/vla.cpp https://github.com/AIWintermuteAI/vla.cpp/pulls (not organized PRs) https://radxa.com/products/orion/o6n/ (not the same as I sued, but same CPU and cheaper) https://www.youtube.com/watch?v=JnldWEexR10

Keyboard shortcuts

On. Switch them off if they collide with your assistive tools; ? still opens this sheet.

Go to

Press g then the letter.

  • gh Latest
  • gs Sources
  • gm Media
  • gv Videos
  • gp Podcasts
  • gc Calendar
  • gd Decoder
  • gz Dataviz
  • ga Datasets
  • gb Blog
  • gk Markets
  • gj Careers
  • gn Prompt Notebook

On this page

  • / Focus search, where there is one
  • t Back to top
  • ? This list
  • Esc Close