Generate serialized data in build script#24

Merged

hendrikvanantwerpen merged 11 commits intoinitial-releasefrom

generate-bpe-data

Oct 4, 2024

Commits on Oct 3, 2024

Add correctness test for o200k
Hendrik van Antwerpen
committed
Add worst-case benchmark and add results to README
Hendrik van Antwerpen
committed

Commits on Oct 4, 2024

Merge pull request #23 from github/add-worstcase-benchmark
hendrikvanantwerpen
authored
Merge remote-tracking branch 'origin/main' into initial-release
Hendrik van Antwerpen
committed
Generate serialized data in build script
Hendrik van Antwerpen
committed
clippy
Hendrik van Antwerpen
committed
Add README
Hendrik van Antwerpen
committed
Bump versions
Hendrik van Antwerpen
committed
Add other token sets as well
Hendrik van Antwerpen
committed
Disable benchmark as a test target
Hendrik van Antwerpen
committed
Typos

Hendrik van Antwerpen
and
tclem
authored