Language Models
rasbt/LLMs-from-scratch🔥 active
▲ +435 ★ this week
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
✂️ Tokenization & Preprocessing🧠 Natural Language Processing
Jupyter NotebookOtherupdated Nov 9, 2026
🏆 #5,140 overall#1067 of 1,375 in Language Models
sail-sg /Attention-Sink
[ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)
$ git clone https://github.com/sail-sg/Attention-Sink.gitStars
164
164
This week
—
Forks
5
5
Language
Python
License
MIT
Created
Oct 13, 2024
2.1 years old
Last push
Jul 8, 2025
Categories
More in Language Models
Language Models
BlinkDL/RWKV-LM
▲ +2 ★ this week
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.
PythonApache-2.0updated Nov 4, 2026
Language Models
neuml/txtai🔥 active
▲ +310 ★ this week
💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows
🔍 Search & Retrieval🧬 Embeddings🧠 Natural Language Processing
PythonApache-2.0updated Nov 13, 2026
Language Models
LLMBook-zh/LLMBook-zh.github.io
▲ +5 ★ this week
《大语言模型》作者：赵鑫，李军毅，周昆，唐天一，文继荣
🧠 Natural Language Processing
Pythonno licenseupdated Sep 2, 2025
Language Models
raiyanyahya/how-to-train-your-gpt
▲ +6 ★ this week
Build a modern LLM from scratch. Every line commented. Explained like we are five.
🧠 Natural Language Processing
Jupyter NotebookMITupdated Oct 26, 2026
Language Models
KimMeen/Time-LLM
▲ +1 ★ this week
[ICLR 2024] Official implementation of " 🦙 Time-LLM: Time Series Forecasting by Reprogramming Large Language Models"
PythonApache-2.0updated Oct 15, 2025
Data from GitHub · snapshot Nov 13, 2026