Tokenization & Preprocessing
ikawaha/kagome🔥 active
▲ +1 ★ this week
Self-contained Japanese Morphological Analyzer written in pure Go
🧠 Natural Language Processing
GoMITupdated Nov 11, 2026
초경량 한국어 형태소 분석기 — 1MB 모델로 브라우저에서 실행(WASM). Ultra-lightweight Korean morphological analyzer in the browser. npm: garu-ko
$ git clone https://github.com/ongjin/garu.git▲ +1 ★ this week
Self-contained Japanese Morphological Analyzer written in pure Go
▲ +2 ★ this week
🎤 vibrato: Viterbi-based accelerated tokenizer
Juman++ (a Morphological Analyzer Toolkit)
▲ +2 ★ this week
🛥 Vaporetto: Very accelerated pointwise prediction based tokenizer
한국어 자연어처리를 위한 파이썬 라이브러리입니다. 단어 추출/ 토크나이저 / 품사판별/ 전처리의 기능을 제공합니다.
Open Korean Text Processor - An Open-source Korean Text Processor
Data from GitHub · snapshot Nov 16, 2026