LLM continuous batching host scheduler in Rust (191k tok/s on 1 vCPU)

(github.com) by bmartin-systems | Sep 15, 2026 | 0 comments on HN