Language Models
explosion/spacy-transformers
🛸 Use pretrained transformers like BERT, XLNet and GPT-2 in spaCy
🧠 Natural Language Processing
PythonMITupdated Mar 27, 2026
🏆 #140 overall#50 of 601 in Language Models🔥 active this week
huggingface /tokenizers
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
$ git clone https://github.com/huggingface/tokenizers.gitStars
11.1K
11,109
Forks
1.2K
1,207
Language
Rust
License
Apache-2.0
Created
Nov 1, 2019
6.9 years old
Last push
Sep 23, 2026
🔥 this week
More in Language Models
Language Models
ashishpatel26/Treasure-of-Transformers
💁 Awesome Treasure of Transformers Models for Natural Language processing contains papers, videos, blogs, official repo along with colab Notebooks. 🛫☑️
🎙️ Speech Recognition🧠 Natural Language Processing
Jupyter NotebookMITupdated Aug 1, 2025
Language Models
SKTBrain/KoBERT
Korean BERT pre-trained cased (KoBERT)
🧠 Natural Language Processing
PythonApache-2.0updated Jun 14, 2025
Language Models
ymcui/MacBERT
Revisiting Pre-trained Models for Chinese Natural Language Processing (MacBERT)
🧠 Natural Language Processing
OtherApache-2.0updated Apr 19, 2026
Language Models
charles9n/bert-sklearn
a sklearn wrapper for Google's BERT model
🏷️ Named Entity Recognition🧠 Natural Language Processing
Jupyter NotebookApache-2.0updated Oct 26, 2022
Language Models
extreme-bert/extreme-bert
ExtremeBERT is a toolkit that accelerates the pretraining of customized language models on customized datasets, described in the paper “ExtremeBERT: A Toolkit for Accelerating Pretraining of Customized BERT”.
🧠 Natural Language Processing
PythonApache-2.0updated Mar 5, 2023
Data from GitHub · snapshot Sep 24, 2026