rasbt/LLMs-from-scratch
▲ +499 ★ this week
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
Build, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6
$ git clone https://github.com/stochasticai/xTuring.git▲ +499 ★ this week
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
▲ +216 ★ this week
🐙 Guides, papers, lessons, notebooks and resources for prompt engineering, context engineering, RAG, and AI Agents.
▲ +5 ★ this week
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.
▲ +16 ★ this week
Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
▲ +7 ★ this week
《大语言模型》作者:赵鑫,李军毅,周昆,唐天一,文继荣
▲ +6 ★ this week
Build a modern LLM from scratch. Every line commented. Explained like we are five.
Data from GitHub · snapshot Nov 16, 2026