Approximation of the Claude 3 tokenizer by inspecting generation streamgithub.com/javirandor9 pointstosh2 years ago