🏆 #4,269 overall#102 of 178 in Tokenization & Preprocessing

adbar /simplemma

Simple multilingual lemmatizer for Python, especially useful for speed and efficiency

$ git clone https://github.com/adbar/simplemma.git
GitHub social preview for adbar/simplemma
Stars
219
219
This week
0 ★
0 this month
Forks
18
18
Language
Python
License
MIT
Created
Jan 18, 2021
5.8 years old
Last push
Nov 6, 2026

Stars, last 30 days

Oct 15, 2026 → Nov 16, 2026
★ 219▲ +0★ 219

Categories

GitHub topics

More in Tokenization & Preprocessing

Tokenization & Preprocessing

JohnSnowLabs/spark-nlp🔥 active

▲ +4 ★ this week

State of the Art Natural Language Processing

🧠 Natural Language Processing🏷️ Named Entity Recognition💖 Sentiment Analysis🗂️ Text Classification❓ Question Answering🌍 Machine Translation
ScalaApache-2.0updated Nov 14, 2026
GitHub ↗★ 4.2K⑂ 743
Tokenization & Preprocessing

daac-tools/vibrato

▲ +2 ★ this week

🎤 vibrato: Viterbi-based accelerated tokenizer

🧠 Natural Language Processing
RustApache-2.0updated Oct 25, 2026
GitHub ↗★ 430⑂ 27
Tokenization & Preprocessing

daac-tools/vaporetto

▲ +2 ★ this week

🛥 Vaporetto: Very accelerated pointwise prediction based tokenizer

🧠 Natural Language Processing
RustApache-2.0updated Nov 3, 2026
GitHub ↗★ 302⑂ 12
Tokenization & Preprocessing

nlpub/pymystem3

A Python wrapper of the Yandex Mystem 3.1 morphological analyzer (http://api.yandex.ru/mystem). The original tool is shipped as a binary and this library makes it easy to integrate it in Python projects. Let us know in the issues if you would like to be involved into the developments or maintenance of this project. If you have any fix or suggestion, please make a pull request. We are very open to accepting any contributions.

PythonOtherupdated Feb 9, 2022
GitHub ↗★ 293⑂ 44
Tokenization & Preprocessing

adbar/trafilatura🔥 active

▲ +43 ★ this week

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

🔍 Search & Retrieval🧠 Natural Language Processing💎 Text Mining
PythonApache-2.0updated Nov 16, 2026
GitHub ↗★ 7.1K⑂ 510
Tokenization & Preprocessing

marcelroed/gigatoken

▲ +2 ★ this week

Language model tokenization at GB/s

🧠 Natural Language Processing
RustMITupdated Nov 2, 2026
GitHub ↗★ 4.2K⑂ 225

Data from GitHub · snapshot Nov 16, 2026