Durable MCP queue for bursty agent tool calls
Agent teams with repeated 429s or overloaded internal services should put a small job queue between agents and shared APIs. Aquifer shows the shape of that layer: agents submit jobs through MCP or HTTP, the runtime stores them in SQLite, then per-upstream workers dispatch at configured request and concurrency limits. The example config sets api.openai.com at 10 RPS with 3 concurrent requests, api.stripe.com at 20 RPS with 5 concurrent requests, and an internal backend at 50 RPS with 10 concurrent requests.
A useful pilot would wrap one high-traffic agent tool behind a durable queue and measure failed calls, queue wait time, retries, and task completion. The test should include an upstream slowdown, since Aquifer’s design allows response headers to reduce the live rate under the configured ceiling. This is a practical support layer for teams whose agents already work but fail when many runs hit the same backend at once.