HK
Heykuki News
Top
New
Best
Ask
Show
Jobs
Toggle theme
Top
New
Best
Ask
Show
Jobs
Request
1.
▲
TokenMonster: Ungreedy tokenizer, outperforming tiktoken by 35%
github.com/alasdairforsythe
discuss
3 years ago
tosh
10 points
2.
▲
Tokenmonster: Determine tokens to optimally represents a dataset
github.com/alasdairforsythe
discuss
3 years ago
anotherpaulg
1 points