Tokenization & Preprocessing
๐ #963 overall#17 of 148 in Tokenization & Preprocessing
RavenProject /Ravencoin
Ravencoin Core integration/staging tree
$ git clone https://github.com/RavenProject/Ravencoin.gitStars
1.1K
1,121
Forks
725
725
Language
C
License
MIT
Created
Jul 9, 2017
9.2 years old
Last push
Aug 18, 2026
Categories
More in Tokenization & Preprocessing
Tokenization & Preprocessing
AgentOps-AI/tokencost
Easy token price estimates for 400+ LLMs. TokenOps.
๐ค Language Models
PythonMITupdated Sep 5, 2025
Tokenization & Preprocessing
Tokenization & Preprocessing
alpkeskin/gotoon
Token-Oriented Object Notation for Go โ JSON for LLMs at half the token cost
GoMITupdated Nov 24, 2025
Tokenization & Preprocessing
toon-format/toon
๐ Token-Oriented Object Notation (TOON) โ compact, human-readable serialization of JSON data for LLM prompts. TypeScript SDK, CLI, benchmarks.
TypeScriptMITupdated Sep 3, 2026
Tokenization & Preprocessing
marcelroed/gigatoken
Language model tokenization at GB/s
๐ง Natural Language Processing
RustMITupdated Sep 2, 2026
Data from GitHub ยท snapshot Sep 24, 2026