toon-format/toon๐ฅ active
โฒ +15 โ this week
๐ Token-Oriented Object Notation (TOON) โ compact, human-readable serialization of JSON data for LLM prompts. TypeScript SDK, CLI, benchmarks.
The official code ๐ฉโ๐ป for - TOTEM: TOkenized Time Series EMbeddings for General Time Series Analysis
$ git clone https://github.com/SaberaTalukder/TOTEM.gitโฒ +15 โ this week
๐ Token-Oriented Object Notation (TOON) โ compact, human-readable serialization of JSON data for LLM prompts. TypeScript SDK, CLI, benchmarks.
โฒ +2 โ this week
Language model tokenization at GB/s
โฒ +1 โ this week
Easy token price estimates for 400+ LLMs. TokenOps.
โฒ +1 โ this week
Ravencoin Core integration/staging tree
โฒ +1 โ this week
Ekphrasis is a text processing tool, geared towards text from social networks, such as Twitter or Facebook. Ekphrasis performs tokenization, word normalization, word segmentation (for splitting hashtags) and spell correction, using word statistics from 2 big corpora (english Wikipedia, twitter - 330mil english tweets).
โฒ +3 โ this week
Ungreedy subword tokenizer and vocabulary trainer for Python, Go, C++ & Javascript
Data from GitHub ยท snapshot Nov 16, 2026