Search & Retrieval
JuliaText/WordTokenizers.jl
High performance tokenizers for natural language processing and other related tasks
✂️ Tokenization & Preprocessing🧠 Natural Language Processing
JuliaOtherupdated Dec 30, 2021
🏆 #2,656 overall#305 of 388 in Search & Retrieval
rth /vtext
Simple NLP in Rust with Python bindings
$ git clone https://github.com/rth/vtext.gitStars
153
153
Forks
10
10
Language
Rust
License
Apache-2.0
Created
Nov 5, 2018
7.9 years old
Last push
Jul 6, 2023
More in Search & Retrieval
Search & Retrieval
artitw/text2text
Text2Text Language Modeling Toolkit
✂️ Tokenization & Preprocessing🧠 Natural Language Processing
PythonOtherupdated Jan 14, 2025
Search & Retrieval
piskvorky/gensim
Topic Modelling for Humans
🫧 Topic Modeling🧬 Embeddings🧠 Natural Language Processing
PythonLGPL-2.1updated Nov 1, 2025
Search & Retrieval
neuml/txtai🔥 active
💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows
🧬 Embeddings🤖 Language Models🧠 Natural Language Processing
PythonApache-2.0updated Sep 23, 2026
Search & Retrieval
beir-cellar/beir
A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.
🧠 Natural Language Processing
PythonApache-2.0updated Oct 16, 2025
Search & Retrieval
naver/splade
SPLADE: sparse neural search (SIGIR21, SIGIR22)
🧠 Natural Language Processing
PythonOtherupdated May 3, 2024
Data from GitHub · snapshot Sep 24, 2026