Same AI Model. 40% Cheaper. Here’s How.

Cloud Codes
9,765 views •

If you use an AI coding assistant, you are likely burning up to 40% of your token budget on pure waste. It’s not because the model is bad—it’s because the software wrapper around the model is paying full price to ask your computer: “Is the test done yet?” 🔔 Subscribe: https://www.youtube.com/channel/UC0DZj1PNa_Fp0MU6uPSKv5w?sub_confirmation=1 💙 Become a Member: https://www.youtube.com/channel/UC0DZj1PNa_Fp0MU6uPSKv5w/join 🐦 Twitter/X: https://x.com/cloud_codes 💬 Discord: https://discord.gg/mhgXXmhrh Unreal Labs recently published benchmark results comparing their open-source harness, Unreal Agent, against OpenAI’s Codex baseline using the exact same underlying model: GPT-6 Astra at extra-high reasoning. Across evaluations like Terminal-Bench 4.0, Unreal Agent achieved an identical 57.9% pass rate while slashing inference costs from $2,350 down to $1,428—a 39.2% reduction. In this architectural deep dive, Cloud Codes dissects how changing the software harness around an AI model dramatically lowers your bill without sacrificing code quality: • The Polling Tax: Why traditional agents waste billable model turns checking on long-running shell commands, paying for an AI to wait when standard software could manage the clock. • Event-Driven Architecture: Inside Unreal Agent’s coordinator, operation manager, and tool translator—executing tasks asynchronously and calling the model only when fresh results arrive. • Tool-Output Compaction: Why sending raw, unedited test logs forces models to reread hundreds of lines of boilerplate, and how stripping routine noise saves tokens while preserving critical failure assertions. • Codex vs. Unreal: Examining Codex’s public `write_stdin` polling interface, parallel tool calling capabilities, and why prompt caching discounts don’t make unnecessary exchanges free. • Auditing the Receipts: Inspecting the linked Harbor framework runs, exposing an unresolved accounting discrepancy on SWE-Atlas ($1,303 vs $1,356), and explaining why an MIT license doesn't make API inference free. If this breakdown helped you stop overpaying for AI coding tokens and understand agent harness engineering, subscribe to Cloud Codes for a new deep dive every week. Build, solve, deploy. 🔗 Resources Mentioned: • Unreal Labs Official Benchmark Report: https://unreallabs.ai/blog/unreal-agent/ • Unreal Agent Open-Source Repository (MIT): https://github.com/unreallabsai/unreal-agent • Unreal Agent Runner CLI Documentation: https://raw.githubusercontent.com/unreallabsai/unreal-agent/main/cmd/unreal-agent-runner/README.md • OpenAI Codex Public Execution Source (write_stdin.rs): https://github.com/openai/codex/blob/main/codex-rs/core/src/tools/handlers/unified_exec/write_stdin.rs • OpenAI Guide to Prompt Caching & Token Pricing: https://developers.openai.com/api/docs/guides/prompt-caching • Harbor Framework Evaluation Benchmark Runs: https://hub.harborframework.com/ ⏱️ Chapters: 0:00 - The 40% Savings Claim (Unreal Agent vs Codex) 0:29 - The Benchmark: Terminal-Bench 4.0 ($1,428 vs $2,350) 1:06 - What Happens Between Decisions? 1:19 - Timeline 1: The Expensive Polling Loop 1:57 - Timeline 2: Asynchronous Event-Driven Execution 2:49 - Inside the Harness: Architecture of Unreal Agent 3:52 - Compacting Tool Outputs (Stop Sending Autobiographies) 5:35 - How Does This Actually Differ from Codex? 7:10 - Separating the Clock from the Bill (Prompt Caching Reality) 8:33 - The Full Benchmark Suite: SWE-Atlas, DeepSWE & ALE-CLI 9:08 - The Missing Numbers: Auditing the Harbor Run Records 10:41 - Open Source MIT License vs Real API Bills 10:53 - How to Audit Your Own Coding Agent 11:53 - Final Verdict: Cost per Verified Result #ai #codingai #codex #softwareengineering #openai #unrealagent #devtools #aiagents #promptcaching #cloudcodes #programming User Queries: unreal agent vs openai codex how to make ai coding agent cheaper unreal labs 40 percent savings benchmark terminal bench 4.0 unreal agent how does unreal agent reduce token cost ai coding agent asynchronous tool calling why are ai coding assistants so expensive prompt caching cost reduction ai agents unreal agent architecture explained reduce input tokens coding agent codex write stdin polling explained open source ai coding harness mit harbor framework ai benchmark runs cost per verified result coding ai cloud codes unreal agent

Keyboard shortcuts

On. Switch them off if they collide with your assistive tools; ? still opens this sheet.

Go to

Press g then the letter.

  • gh Latest
  • gs Sources
  • gm Media
  • gv Videos
  • gp Podcasts
  • gc Calendar
  • gd Decoder
  • gz Dataviz
  • ga Datasets
  • gb Blog
  • gk Markets
  • gj Careers
  • gn Prompt Notebook

On this page

  • / Focus search, where there is one
  • t Back to top
  • ? This list
  • Esc Close