Tokenization & Preprocessing
adbar/simplemma🔥 active
Simple multilingual lemmatizer for Python, especially useful for speed and efficiency
🧠 Natural Language Processing
PythonMITupdated Nov 6, 2026
🏆 #3,521 overall#81 of 178 in Tokenization & Preprocessing
nlpub /pymystem3
A Python wrapper of the Yandex Mystem 3.1 morphological analyzer (http://api.yandex.ru/mystem). The original tool is shipped as a binary and this library makes it easy to integrate it in Python projects. Let us know in the issues if you would like to be involved into the developments or maintenance of this project. If you have any fix or suggestion, please make a pull request. We are very open to accepting any contributions.
$ git clone https://github.com/nlpub/pymystem3.gitStars
293
293
This week
—
Forks
44
44
Language
Python
License
Other
Created
Aug 14, 2014
12.2 years old
Last push
Feb 9, 2022
Categories
More in Tokenization & Preprocessing
Tokenization & Preprocessing
CogComp/cogcomp-nlp
CogComp's Natural Language Processing Libraries and Demos: Modules include lemmatizer, ner, pos, prep-srl, quantifier, question type, relation-extraction, similarity, temporal normalizer, tokenizer, transliteration, verb-sense, and more.
🏷️ Named Entity Recognition🧠 Natural Language Processing⛏️ Information Extraction
JavaOtherupdated Jul 7, 2023
Tokenization & Preprocessing
ku-nlp/jumanpp
Juman++ (a Morphological Analyzer Toolkit)
🧠 Natural Language Processing
C++Apache-2.0updated Oct 13, 2026
Tokenization & Preprocessing
huspacy/huspacy
▲ +1 ★ this week
HuSpaCy: industrial-strength Hungarian natural language processing
🧠 Natural Language Processing🏷️ Named Entity Recognition⛏️ Information Extraction💎 Text Mining
PythonApache-2.0updated Nov 19, 2025
Tokenization & Preprocessing
Qutuf/Qutuf
Qutuf (قُطُوْف): An Arabic Morphological analyzer and Part-Of-Speech tagger as an Expert System.
Pythonno licenseupdated Dec 12, 2022
Tokenization & Preprocessing
vhyza/elasticsearch-analysis-lemmagen
Elasticsearch lemmatizer for 15 languages
JavaApache-2.0updated Dec 6, 2024
Data from GitHub · snapshot Nov 13, 2026