Sors: a Rust proxy that reorders prompts to maximize vLLM prefix cache hits

(github.com) by flaccount | Jun 16, 2026 | 0 comments on HN