A new Rust-based BPE tokenizer, known as Gigatoken, has demonstrated impressive performance in text encoding. On a high-end AMD EPYC processor, Gigatoken achieved a speed of 24.53 GB/s, significantly outpacing existing tokenizers such as HuggingFace and tiktoken. This performance gain is attributed to a custom-designed pre-tokenizer and caching mechanism, rather than a faster token merge process. The open-source tokenizer is now available under the MIT license. This development has implications for applications that rely heavily on text processing and tokenization, potentially leading to faster and more efficient operations.