Language Models
huggingface/tokenizers🔥 active
▲ +21 ★ this week
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
🧠 Natural Language Processing
RustApache-2.0updated Nov 16, 2026
SlamKit is an open source tool kit for efficient training of SpeechLMs. It was used for "Slamming: Training a Speech Language Model on One GPU in a Day"
$ git clone https://github.com/slp-rl/slamkit.git▲ +21 ★ this week
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
▲ +4 ★ this week
An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries
A curriculum for learning about foundation models, from scratch to the frontier
▲ +1 ★ this week
Korean BERT pre-trained cased (KoBERT)
▲ +1 ★ this week
CKIP Transformers
Data from GitHub · snapshot Nov 16, 2026