๐Ÿ† #91 overall#3 of 178 in Tokenization & Preprocessing๐Ÿ”ฅ active this week

toon-format /toon

๐ŸŽ’ Token-Oriented Object Notation (TOON) โ€“ compact, human-readable serialization of JSON data for LLM prompts. TypeScript SDK, CLI, benchmarks.

$ git clone https://github.com/toon-format/toon.git
GitHub social preview for toon-format/toon
Stars
25.6K
25,634
This week
+15 โ˜…
+127 this month
Forks
1.1K
1,126
Language
TypeScript
License
MIT
Created
Oct 22, 2025
1.1 years old
Last push
Nov 11, 2026
๐Ÿ”ฅ this week

Stars, last 30 days

Oct 15, 2026 โ†’ Nov 16, 2026
โ˜… 25.5Kโ–ฒ +133โ˜… 25.6K

Categories

GitHub topics

More in Tokenization & Preprocessing

Tokenization & Preprocessing

ScrapeGraphAI/toonify

โ–ฒ +1 โ˜… this week

Toonify: Compact data format reducing LLM token usage by 30-60%

Pythonno licenseupdated Feb 6, 2026
GitHub โ†—โ˜… 367โ‘‚ 29
Tokenization & Preprocessing

marcelroed/gigatoken

โ–ฒ +2 โ˜… this week

Language model tokenization at GB/s

๐Ÿง  Natural Language Processing
RustMITupdated Nov 2, 2026
GitHub โ†—โ˜… 4.2Kโ‘‚ 225
Tokenization & Preprocessing

AgentOps-AI/tokencost

โ–ฒ +1 โ˜… this week

Easy token price estimates for 400+ LLMs. TokenOps.

๐Ÿค– Language Models
PythonMITupdated Sep 5, 2025
GitHub โ†—โ˜… 2Kโ‘‚ 109
Tokenization & Preprocessing

ImadSaddik/Train_Your_Language_Model_Course

Train a language model to chat like you using your personal conversations from WhatsApp, Telegram, Signal, or other platforms.

Jupyter Notebookno licenseupdated Sep 26, 2025
GitHub โ†—โ˜… 293โ‘‚ 161
Tokenization & Preprocessing

alpkeskin/gotoon

Token-Oriented Object Notation for Go โ€“ JSON for LLMs at half the token cost

GoMITupdated Nov 24, 2025
GitHub โ†—โ˜… 241โ‘‚ 15
Tokenization & Preprocessing

ash-01xor/bpe.c

โ–ฒ +1 โ˜… this week

Simple Byte pair Encoding mechanism used for tokenization process . written purely in C

CMITupdated Nov 11, 2024
GitHub โ†—โ˜… 158โ‘‚ 4

Data from GitHub ยท snapshot Nov 16, 2026