Natural Language Processing
pemistahl/lingua-rs🔥 active
The most accurate natural language detection library for Rust, suitable for short text and mixed-language text
RustApache-2.0updated Nov 5, 2026
Japanese Input Method System for Linux, macOS, Neural Kana-Kanji Conversion Engine
$ git clone https://github.com/togatoga/karukan.gitThe most accurate natural language detection library for Rust, suitable for short text and mixed-language text
面向中文输入法的语言模型:语料、n-gram 统计、字级神经模型,以及判断它们好坏的评测集
🎤 vibrato: Viterbi-based accelerated tokenizer
A Japanese tokenizer based on recurrent neural networks
🛥 Vaporetto: Very accelerated pointwise prediction based tokenizer
中文分词 词性标注 命名实体识别 依存句法分析 成分句法分析 语义依存分析 语义角色标注 指代消解 风格转换 语义相似度 新词发现 关键词短语提取 自动摘要 文本分类聚类 拼音简繁转换 自然语言处理
Data from GitHub · snapshot Nov 9, 2026