jaymody/picoGPT
An unnecessarily tiny implementation of GPT-2 in NumPy.
Experimental playground for benchmarking language model (LM) architectures, layers, and tricks on smaller datasets. Designed for flexible experimentation and exploration.
$ git clone https://github.com/erogol/BlaGPT.gitAn unnecessarily tiny implementation of GPT-2 in NumPy.
A hands-on course on modern LLM architectures, training, and inference, with step-by-step PyTorch implementations and runnable notebooks.
零基础入门大模型(LLM)的基础教程:从零手写 GPT-2,一行行看懂大模型是怎么工作的 | Build GPT-2 from scratch in PyTorch, step by step
从 MiniMind 源码读起,再延伸到现代大模型技术体系的中文学习笔记。主线逐行精读预训练 / SFT / DPO / PPO / GRPO 与训练机制;附录 17 篇进阶卷覆盖量化、投机解码、RLHF 全景、模型代际史等 MiniMind 没涉及、但进阶绕不开的主题。
Implementation of the LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens Paper
<밑바닥부터 만들면서 공부하는 LLM>(길벗, 2025)의 코드 저장소
Data from GitHub · snapshot Nov 13, 2026