Search & Retrieval
JuliaText/WordTokenizers.jl
High performance tokenizers for natural language processing and other related tasks
✂️ Tokenization & Preprocessing🧠 Natural Language Processing
JuliaOtherupdated Dec 30, 2021
Simple NLP in Rust with Python bindings
$ git clone https://github.com/rth/vtext.gitHigh performance tokenizers for natural language processing and other related tasks
▲ +1 ★ this week
Text2Text Language Modeling Toolkit
Topic Modelling for Humans
▲ +300 ★ this week
💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows
▲ +1 ★ this week
A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.
▲ +2 ★ this week
SPLADE: sparse neural search (SIGIR21, SIGIR22)
Data from GitHub · snapshot Nov 16, 2026