Train a Tiny GPT, Part 1: Tokenizers
Build a byte-level BPE tokenizer in about 100 lines of Python, then compare it to tiktoken's gpt2, cl100k_base and o200k_base on prose, code, YAML and German.
Tag: tiny-gpt
All the articles with the tag "tiny-gpt".