Quartermaster Cuts Tool Calls 40% On The Same Tasks.
Tool calls per task
QUARTERMASTER, CODEXThree replications, same result each time.
Pass rate
150 RUNS POOLEDAhead in all three replications.
Quartermaster (QM) is an agent harness from YC that runs Codex in a Docker sandbox. Memorable stores procedures in QM's own Postgres. Every measured run used a fresh copy of the fixture, consent flipped read-only, and pass decided by sh test.sh run by the harness.
Five Tool Calls To Fix The Same Bug, Every Time.
Same three-bug fixture, fresh copy per run. Without a stored procedure Codex re-read the repo before every fix. In the five-family campaign, three of the four baseline failures quit after zero or one tool call.
The Stored Steps, Injected Every Turn.
The orchestrator injects the recalled procedure every turn, with a timeout and a size cap so it cannot block a run. The agent gets the steps that finished the task last time and skips the search.
Without memory
NO MEMORYFive tool calls per task.
Three of the four baseline failures quit after zero or one tool call.
Across every run.
With Memorable
PROCEDURAL MEMORYThree tool calls per task.
The pointer keeps the agent from quitting on the first miss.
Ahead in all three replications.
Adapter, Per-Turn Injection, Postgres.
One adapter
One adapter over QM's core tool set captures every agent loop. Each tool call is joined to its result, so the procedure records what ran and what came back.
Tool Calls Down 40%. Pass Rate 91%.
| Metric | Without memory | With Memorable | How it was measured |
|---|---|---|---|
| Tool calls per task | 5 | 3 | Three replications |
| Pass rate | 80% | 91% | Ahead in all three replications |
| Five task families, tool calls | 4 | 2 | One shared store. Recall picked the right family every time |
| Five task families, pass rate | 87% | 97% | Order bugfix, config drift, crash-log triage, CSV repair, stale-caller rename |