1gbps Tokenizer written in Assembly. 20x faster than HuggingFace

(github.com) by dogmaticdev | Apr 25, 2026 | 1 comments on HN