Language Models
huggingface/tokenizers🔥 active
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
🧠 Natural Language Processing
RustApache-2.0updated Sep 23, 2026
🏆 #839 overall#235 of 601 in Language Models
explosion /spacy-transformers
🛸 Use pretrained transformers like BERT, XLNet and GPT-2 in spaCy
$ git clone https://github.com/explosion/spacy-transformers.gitStars
1.4K
1,409
Forks
179
179
Language
Python
License
MIT
Created
Jul 26, 2019
7.2 years old
Last push
Mar 27, 2026
More in Language Models
Language Models
ashishpatel26/Treasure-of-Transformers
💁 Awesome Treasure of Transformers Models for Natural Language processing contains papers, videos, blogs, official repo along with colab Notebooks. 🛫☑️
🎙️ Speech Recognition🧠 Natural Language Processing
Jupyter NotebookMITupdated Aug 1, 2025
Language Models
extreme-bert/extreme-bert
ExtremeBERT is a toolkit that accelerates the pretraining of customized language models on customized datasets, described in the paper “ExtremeBERT: A Toolkit for Accelerating Pretraining of Customized BERT”.
🧠 Natural Language Processing
PythonApache-2.0updated Mar 5, 2023
Language Models
csinva/imodelsX
Interpret text data with LLMs (sklearn compatible).
🗂️ Text Classification🧠 Natural Language Processing
PythonMITupdated Apr 22, 2026
Language Models
NVIDIA-Merlin/Transformers4Rec
Transformers4Rec is a flexible and efficient library for sequential and session-based recommendation and works with PyTorch.
🧠 Natural Language Processing
PythonApache-2.0updated Aug 23, 2026
Language Models
primeqa/primeqa
The prime repository for state-of-the-art Multilingual Question Answering research and development.
❓ Question Answering🔍 Search & Retrieval🧠 Natural Language Processing
PythonApache-2.0updated Sep 18, 2025
Data from GitHub · snapshot Sep 24, 2026