Tokenization Is a Problem for LLMs

by remiloufon 2/4/2024, 4:13 PMwith 1 comments

by remiloufon 2/4/2024, 4:13 PM

This article presents a way to make structured generation with LLMs much faster than standard generation, but what I find most interesting is how it highlights the issues that tokenization entails towards the end.