Speculative KV coding: losslessly compressing KV cache by up to ~4×

(fergusfinn.com) by kkm | Jun 4, 2026 | 0 comments on HN