JohnSnowLabs/spark-nlp🔥 active
▲ +4 ★ this week
State of the Art Natural Language Processing
Simple multilingual lemmatizer for Python, especially useful for speed and efficiency
$ git clone https://github.com/adbar/simplemma.git▲ +4 ★ this week
State of the Art Natural Language Processing
▲ +2 ★ this week
🎤 vibrato: Viterbi-based accelerated tokenizer
▲ +2 ★ this week
🛥 Vaporetto: Very accelerated pointwise prediction based tokenizer
A Python wrapper of the Yandex Mystem 3.1 morphological analyzer (http://api.yandex.ru/mystem). The original tool is shipped as a binary and this library makes it easy to integrate it in Python projects. Let us know in the issues if you would like to be involved into the developments or maintenance of this project. If you have any fix or suggestion, please make a pull request. We are very open to accepting any contributions.
▲ +43 ★ this week
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
▲ +2 ★ this week
Language model tokenization at GB/s
Data from GitHub · snapshot Nov 16, 2026