//
sign in
Post
by @danabra.mov
PostEmbed
by @danabra.mov
Record
by @jimpick.com
Record
by @atsui.org
+ new component
Post
Today's funny tokenization realization: The GPT4 tokenizer has 1 single token for the entire lower- and uppercase alphabet.
Feb 27, 2025
David Vos