Language Models
huggingface/tokenizersπ₯ active
π₯ Fast State-of-the-Art Tokenizers optimized for Research and Production
π§ Natural Language Processing
RustApache-2.0updated Sep 23, 2026
π #2,429 overall#562 of 601 in Language Models
kanishkamisra /minicons
Utility for behavioral and representational analyses of Language Models
$ git clone https://github.com/kanishkamisra/minicons.gitStars
195
195
Forks
46
46
Language
Python
License
MIT
Created
Jun 11, 2020
6.3 years old
Last push
Jul 22, 2026
More in Language Models
Language Models
LLMBook-zh/LLMBook-zh.github.io
γ倧θ―θ¨ζ¨‘εγδ½θ οΌθ΅΅ι«οΌζεζ― οΌε¨ζοΌε倩δΈοΌζ继θ£
π§ Natural Language Processing
Pythonno licenseupdated Sep 2, 2025
Language Models
chiphuyen/lazynlp
Library to scrape and clean web pages to create massive datasets.
π§ Natural Language Processingπ Text Mining
Pythonno licenseupdated Nov 11, 2020
Language Models
SKTBrain/KoBERT
Korean BERT pre-trained cased (KoBERT)
π§ Natural Language Processing
PythonApache-2.0updated Jun 14, 2025
Language Models
explosion/spacy-transformers
πΈ Use pretrained transformers like BERT, XLNet and GPT-2 in spaCy
π§ Natural Language Processing
PythonMITupdated Mar 27, 2026
Language Models
ashishpatel26/Treasure-of-Transformers
π Awesome Treasure of Transformers Models for Natural Language processing contains papers, videos, blogs, official repo along with colab Notebooks. π«βοΈ
ποΈ Speech Recognitionπ§ Natural Language Processing
Jupyter NotebookMITupdated Aug 1, 2025
Data from GitHub Β· snapshot Sep 24, 2026