🏆 #1,449 overall#25 of 178 in Tokenization & Preprocessing

lovit /soynlp

한국어 자연어처리를 위한 파이썬 라이브러리입니다. 단어 추출/ 토크나이저 / 품사판별/ 전처리의 기능을 제공합니다.

$ git clone https://github.com/lovit/soynlp.git
GitHub social preview for lovit/soynlp
Stars
996
996
This week
0 ★
+2 this month
Forks
181
181
Language
Python
License
Other
Created
May 13, 2017
9.5 years old
Last push
Oct 4, 2026

Stars, last 30 days

Oct 15, 2026 → Nov 16, 2026
★ 994▲ +2★ 996

Categories

GitHub topics

More in Tokenization & Preprocessing

Tokenization & Preprocessing

ongjin/garu🔥 active

▲ +1 ★ this week

초경량 한국어 형태소 분석기 — 1MB 모델로 브라우저에서 실행(WASM). Ultra-lightweight Korean morphological analyzer in the browser. npm: garu-ko

🧠 Natural Language Processing
TypeScriptApache-2.0updated Nov 16, 2026
GitHub ↗★ 183⑂ 9
Tokenization & Preprocessing

marcelroed/gigatoken

▲ +2 ★ this week

Language model tokenization at GB/s

🧠 Natural Language Processing
RustMITupdated Nov 2, 2026
GitHub ↗★ 4.2K⑂ 225
Tokenization & Preprocessing

natasha/natasha

Solves basic Russian NLP tasks, API for lower level Natasha projects

🏷️ Named Entity Recognition🧠 Natural Language Processing
PythonMITupdated Oct 14, 2026
GitHub ↗★ 1.4K⑂ 122
Tokenization & Preprocessing

SeanLee97/xmnlp

xmnlp:提供中文分词, 词性标注, 命名体识别,情感分析,文本纠错,文本转拼音,文本摘要,偏旁部首,句子表征及文本相似度计算等功能

💖 Sentiment Analysis🏷️ Named Entity Recognition🧬 Embeddings🧠 Natural Language Processing
PythonApache-2.0updated Nov 12, 2022
GitHub ↗★ 1.3K⑂ 181
Tokenization & Preprocessing

cbaziotis/ekphrasis

▲ +1 ★ this week

Ekphrasis is a text processing tool, geared towards text from social networks, such as Twitter or Facebook. Ekphrasis performs tokenization, word normalization, word segmentation (for splitting hashtags) and spell correction, using word statistics from 2 big corpora (english Wikipedia, twitter - 330mil english tweets).

🧠 Natural Language Processing💎 Text Mining
PythonMITupdated Jun 2, 2025
GitHub ↗★ 672⑂ 91
Tokenization & Preprocessing

open-korean-text/open-korean-text

Open Korean Text Processor - An Open-source Korean Text Processor

🧠 Natural Language Processing💎 Text Mining
ScalaApache-2.0updated Mar 12, 2024
GitHub ↗★ 668⑂ 95

Data from GitHub · snapshot Nov 16, 2026