28 Times faster than Google's LLM tokenizer

(o200k-tokenizer-70fe25.gitlab.io) by nispin | Apr 4, 2026 | 0 comments on HN