Tokenization & Preprocessing
bitextor/bitextor
Bitextor generates translation memories from multilingual websites
🌍 Machine Translation
PythonGPL-3.0updated Nov 11, 2024
An Integrated Corpus Tool With Multilingual Support for the Study of Language, Literature, and Translation
$ git clone https://github.com/BLKSerene/Wordless.gitBitextor generates translation memories from multilingual websites
Simple multilingual lemmatizer for Python, especially useful for speed and efficiency
DadmaTools is a Persian NLP tools developed by Dadmatech Co.
▲ +43 ★ this week
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
▲ +4 ★ this week
State of the Art Natural Language Processing
▲ +1 ★ this week
Persian NLP Toolkit
Data from GitHub · snapshot Nov 16, 2026