🏆 #6,663 overall#167 of 178 in Tokenization & Preprocessing

togatoga /kanpyo

Japanese Morphological Analyzer written in Rust

$ git clone https://github.com/togatoga/kanpyo.git
GitHub social preview for togatoga/kanpyo
Stars
108
108
This week
0 ★
-1 this month
Forks
1
1
Language
Rust
License
MIT
Created
Oct 11, 2023
3.1 years old
Last push
Oct 9, 2026

Stars, last 30 days

Oct 15, 2026 → Nov 16, 2026
★ 109▼ 1★ 108

Categories

GitHub topics

More in Tokenization & Preprocessing

Tokenization & Preprocessing

daac-tools/vibrato

▲ +2 ★ this week

🎤 vibrato: Viterbi-based accelerated tokenizer

🧠 Natural Language Processing
RustApache-2.0updated Oct 25, 2026
GitHub ↗★ 430⑂ 27
Tokenization & Preprocessing

daac-tools/vaporetto

▲ +2 ★ this week

🛥 Vaporetto: Very accelerated pointwise prediction based tokenizer

🧠 Natural Language Processing
RustApache-2.0updated Nov 3, 2026
GitHub ↗★ 302⑂ 12
Tokenization & Preprocessing

ikawaha/kagome🔥 active

▲ +1 ★ this week

Self-contained Japanese Morphological Analyzer written in pure Go

🧠 Natural Language Processing
GoMITupdated Nov 11, 2026
GitHub ↗★ 988⑂ 61
Tokenization & Preprocessing

lindera/lindera🔥 active

▲ +3 ★ this week

A multilingual morphological analysis library.

RustMITupdated Nov 16, 2026
GitHub ↗★ 708⑂ 70
Tokenization & Preprocessing

polm/fugashi

▲ +1 ★ this week

A Cython MeCab wrapper for fast, pythonic Japanese tokenization and morphological analysis.

🧠 Natural Language Processing
C++MITupdated Oct 24, 2025
GitHub ↗★ 538⑂ 40
Tokenization & Preprocessing

taishi-i/nagisa🔥 active

▲ +1 ★ this week

A Japanese tokenizer based on recurrent neural networks

🧠 Natural Language Processing
PythonMITupdated Nov 14, 2026
GitHub ↗★ 424⑂ 24

Data from GitHub · snapshot Nov 16, 2026