They Trained an AI for Just $146 — I Tested It!
Laghu is a 152M-parameter chat model its team says cost $146 to pretrain. I ran it on my RTX 4060 laptop, tested 13 prompts, and show every answer, including the failures. Chapters 0:00 The $146 shock 0:17 The pain point 0:31 The plan 0:54 Intro from me 0:59 Who made Laghu 1:33 What the $146 bought 2:09 The three training stages 2:28 Architecture and memory 3:03 Four ways to run it 3:26 Install with Ollama 4:02 Speed on an RTX 4060 4:15 Tests: maths, puzzles, thinking, facts, code, Hindi, memory, format 7:02 My scoreboard 7:26 Limits of my test 7:55 What the developers report 8:34 What went wrong for them 8:56 Who Laghu is for 9:19 Back to the pain point 9:35 Your question for a 150M model 9:55 Outro Run it yourself (Ollama): ollama run hf.co/udgamlabs/Laghu-GGUF:Q8_0 --think=false Links Write-up: https://huggingface.co/blog/udgamlabs/laghu Model: https://huggingface.co/udgamlabs/Laghu GGUF: https://huggingface.co/udgamlabs/Laghu-GGUF Free Space: https://huggingface.co/spaces/udgamlabs/Laghu My test results (thinking off, temperature 0.3, 13 prompts): 3 pass, 5 mixed, 5 fail. Small sample, not a benchmark. Training cost and benchmark scores are developer-reported; I did not reproduce them. RunPod: https://get.runpod.io/pe48 Disclosure: this is my affiliate link, so I may earn a commission if you sign up, at no extra cost to you. Disclosure: the intro and outro avatar and the thumbnail are AI-generated likenesses of the creator. Get GPUs Runpod: https://get.runpod.io/pe48 Get Hostinger: https://www.hostg.xyz/SHJiu Coupon Code "PROMPT" 10% discount 🔗 Connect with me: Email → [email protected] Ko-fi → https://ko-fi.com/promptengineer Patreon → https://www.patreon.com/PromptEngineer975 Book a Call → https://calendly.com/prompt-engineer48/call GitHub → https://github.com/PromptEngineer48 Twitter/X → https://twitter.com/prompt48 Website → https://promptengineer48.com/