
Muscle Memory Cache for Agents
Butter is building an LLM proxy that records and deterministically replays tool call trajectories. Our goal is to get LLMs out of the hotpath for repetitive tasks, increasing speed, reducing variability, and eliminating token costs for the many cases that could have just been a script.
Why
We discovered this problem after experiencing it first-hand building computer-use agents. We realized that many process-automation tasks are deeply repetitive, simple data transformation tasks that could be run as scripts. Critically, the user pull to agents was not to replace these scripts with agents, but to use agents to discover and self-heal the scripts when new edge cases are encountered.
We believe these cases exist even beyond computer-use, to any agent tasked to perform repeat workflows. Learn a skill once, run it forever.
As an LLM proxy, we act as the LLM, spoofing responses to deterministically guide agents down cached paths, or cleanly falling back to actual LLMs on cache miss.