Stop Paying Extra for Bloated AI Agent Harnesses That Don't Work Any Better

We’ve all been bombarded with shiny new coding agent frameworks over the past few months. From Claude Code to OpenCode and mini-SWE-agent, every developer ecosystem wants you to believe their custom harness is the secret sauce that finally turns a base LLM into a senior engineer. But if you have ever looked at your API dashboard after letting one of these agents loop through a bug fix, you probably had a sinking feeling in your stomach.

A recent controlled study just confirmed what many hands-on builders have been whispering in Discord channels: fancy agent harnesses are mostly inflating your cloud bills without actually making the code any better.

The study put several popular coding agent setups through rigorous benchmarking to see if changing the harness—the wrapper that handles tool calls, execution loops, and prompt assembly—actually improves problem-solving capabilities. The results were painfully clear. Switching between slick, feature-heavy harnesses barely moved the needle on benchmark pass rates. In fact, the variation in success was practically identical to simply running the exact same lightweight agent twice and hoping for better luck on the second run.

Where you do see a massive difference, however, is in your wallet. The cost per completed task spiked by up to 300 percent on certain frameworks.

Why the sudden cash drain? It all comes down to prompt bloat and inefficient context management. Many of these harnesses repackage massive, static system prompts and re-send them to the API provider with every single step the agent takes. Unless you are aggressively leveraging prompt caching—and let’s be honest, half these open-source harnesses don't configure it properly out of the box—you are paying top dollar to re-digest hundreds of instructions over and over again.

As someone who builds with these tools daily, this hits home. We don't need hyper-complex, multi-layered wrapper frameworks that re-invent prompt engineering at every turn. What developers actually need are lightweight, predictable loops with tight token management and clean tool execution.

This study is a healthy reality check for the AI agent ecosystem. The era of hand-waving 'agentic magic' is giving way to cold, hard unit economics. If a tool costs triple the price for a zero percent increase in task resolution, it's not an upgrade—it's bloated software. Before you migrate your workflow to the next hyped harness, benchmark your token usage first. You might find that a simple script gets the job done at a fraction of the cost.

Photo: Kelly Sikkema / Unsplash (https://unsplash.com/@kellysikkema)