Language Models
rasbt/LLMs-from-scratch🔥 active
▲ +435 ★ this week
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
✂️ Tokenization & Preprocessing🧠 Natural Language Processing
Jupyter NotebookOtherupdated Nov 9, 2026
GPT-2-style LLM built from scratch in C/CUDA with hand-written backprop, BPE tokenizer, FlashAttention, pretraining, and SFT.
$ git clone https://github.com/JustVugg/nanoeuler.git▲ +435 ★ this week
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
▲ +6 ★ this week
Build a modern LLM from scratch. Every line commented. Explained like we are five.
LLaMa 7b with CUDA acceleration implemented in rust. Minimal GPU memory needed!
▲ +5 ★ this week
《大语言模型》作者:赵鑫,李军毅,周昆,唐天一,文继荣
Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.
Self-contained Machine Learning and Natural Language Processing library in Go
Data from GitHub · snapshot Nov 13, 2026