Language Models
jshuadvd/LongRoPE
Implementation of the LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens Paper
🧠 Natural Language Processing✂️ Tokenization & Preprocessing
Pythonno licenseupdated Jul 20, 2024
🏆 #4 overall#3 of 601 in Language Models
rasbt /LLMs-from-scratch
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
$ git clone https://github.com/rasbt/LLMs-from-scratch.gitStars
106.6K
106,580
Forks
16.4K
16,401
Language
Jupyter Notebook
License
Other
Created
Jul 23, 2023
3.2 years old
Last push
Oct 2, 2026
More in Language Models
Language Models
raiyanyahya/how-to-train-your-gpt
Build a modern LLM from scratch. Every line commented. Explained like we are five.
🧠 Natural Language Processing
Jupyter NotebookMITupdated Aug 30, 2026
Language Models
analyticalrohit/llms-from-scratch
Build a ChatGPT like LLM from scratch in PyTorch, explained step by step.
✂️ Tokenization & Preprocessing
Jupyter NotebookMITupdated Jun 8, 2026
Language Models
theaniketgiri/create-llm
The fastest way to build and start training your own LLM. CLI tool that scaffolds production-ready PyTorch training projects in seconds. Like create-next-app but for language models.
🧠 Natural Language Processing
TypeScriptMITupdated Sep 13, 2026
Language Models
microsoft/generative-ai-for-beginners🔥 active
21 Lessons, Get Started Building with Generative AI
🔍 Search & Retrieval
Jupyter NotebookMITupdated Oct 15, 2026
Language Models
BlinkDL/RWKV-LM
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.
PythonApache-2.0updated Sep 28, 2026
Data from GitHub · snapshot Oct 15, 2026