🏆 #3,853 overall#96 of 178 in Tokenization & Preprocessing

CodeChain-io /codechain

CodeChain's official implementation in Rust.

$ git clone https://github.com/CodeChain-io/codechain.git
GitHub social preview for CodeChain-io/codechain
Stars
258
258
This week
0 ★
0 this month
Forks
50
50
Language
Rust
License
AGPL-3.0
Created
Jan 23, 2018
8.8 years old
Last push
Jan 7, 2023

Stars, last 30 days

Oct 15, 2026 → Nov 16, 2026
★ 258▲ +0★ 258

Categories

GitHub topics

More in Tokenization & Preprocessing

Tokenization & Preprocessing

RavenProject/Ravencoin

▲ +1 ★ this week

Ravencoin Core integration/staging tree

CMITupdated Aug 18, 2026
GitHub ↗★ 1.1K⑂ 727
Tokenization & Preprocessing

WorksApplications/sudachi.rs

▲ +2 ★ this week

Sudachi in Rust 🦀 and new generation of SudachiPy

RustApache-2.0updated Oct 2, 2026
GitHub ↗★ 492⑂ 64
Tokenization & Preprocessing

daac-tools/vibrato

▲ +2 ★ this week

🎤 vibrato: Viterbi-based accelerated tokenizer

🧠 Natural Language Processing
RustApache-2.0updated Oct 25, 2026
GitHub ↗★ 430⑂ 27
Tokenization & Preprocessing

daac-tools/vaporetto

▲ +2 ★ this week

🛥 Vaporetto: Very accelerated pointwise prediction based tokenizer

🧠 Natural Language Processing
RustApache-2.0updated Nov 3, 2026
GitHub ↗★ 302⑂ 12
Tokenization & Preprocessing

toon-format/toon🔥 active

▲ +15 ★ this week

🎒 Token-Oriented Object Notation (TOON) – compact, human-readable serialization of JSON data for LLM prompts. TypeScript SDK, CLI, benchmarks.

TypeScriptMITupdated Nov 11, 2026
GitHub ↗★ 25.6K⑂ 1.1K

Data from GitHub · snapshot Nov 16, 2026