Natural Language Processing
huggingface/tokenizersπ₯ active
β² +21 β this week
π₯ Fast State-of-the-Art Tokenizers optimized for Research and Production
π€ Language Models
RustApache-2.0updated Nov 16, 2026
πΈ Use pretrained transformers like BERT, XLNet and GPT-2 in spaCy
$ git clone https://github.com/explosion/spacy-transformers.gitβ² +21 β this week
π₯ Fast State-of-the-Art Tokenizers optimized for Research and Production
π Awesome Treasure of Transformers Models for Natural Language processing contains papers, videos, blogs, official repo along with colab Notebooks. π«βοΈ
ExtremeBERT is a toolkit that accelerates the pretraining of customized language models on customized datasets, described in the paper βExtremeBERT: A Toolkit for Accelerating Pretraining of Customized BERTβ.
Interpret text data with LLMs (sklearn compatible).
θ―δΌ°θͺηΆθ―θ¨ηζ΅η εΊ¦
β² +1 β this week
Cybertron: the home planet of the Transformers in Go
Data from GitHub Β· snapshot Nov 16, 2026