Long-context control
A large context window has limited value when every turn recomputes the full history or useful information becomes hard to retrieve. qMLX restores key-value (KV) attention state from disk and fixes prefix-matching and interrupted-history bugs. On one M3 Ultra, repeated prefill for 32,000 tokens fell from 88 seconds to 0.64 seconds; a short follow-up at 168,000 tokens reached its first token in 2.6 seconds.
ContextOps checks duplicated retrieval chunks, prompt growth, source concentration, and token imbalance before a large language model (LLM) runs. Its sample found 214 duplicated tokens and estimated 12% savings. A separate social-media excerpt reports retrieval falling from 80% at 256,000 tokens to 36% at one million, but gives no dataset or protocol. Together, these items support tighter context measurement; only the qMLX report provides detailed runtime measurements, and those come from a single machine.