Language Models
AviSoori1x/makeMoE
From scratch implementation of a sparse mixture of experts language model inspired by Andrej Karpathy's makemore :)
Jupyter NotebookMITupdated Oct 30, 2024
🏆 #3,804 overall#836 of 1,375 in Language Models
AviSoori1x /seemore
From scratch implementation of a vision language model in pure PyTorch
$ git clone https://github.com/AviSoori1x/seemore.gitStars
262
262
This week
—
Forks
31
31
Language
Jupyter Notebook
License
MIT
Created
Apr 17, 2024
2.6 years old
Last push
May 6, 2024
Categories
More in Language Models
Language Models
JohnMachado11/Build-a-Large-Language-Model-from-Scratch
Building a GPT-like LLM from scratch with PyTorch.
Pythonno licenseupdated Dec 20, 2024
Language Models
Lightning-AI/litgpt🔥 active
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
PythonApache-2.0updated Nov 10, 2026
Language Models
rasbt/reasoning-from-scratch
▲ +31 ★ this week
Implement a reasoning LLM in PyTorch from scratch, step by step
Jupyter NotebookApache-2.0updated Nov 2, 2026
Language Models
ictnlp/LLaVA-Mini
LLaVA-Mini is a unified large multimodal model (LMM) that can support the understanding of images, high-resolution images, and videos in an efficient manner.
PythonApache-2.0updated Jun 29, 2025
Language Models
aa1143/NamiGPT
零基础入门大模型（LLM）的基础教程：从零手写 GPT-2，一行行看懂大模型是怎么工作的 | Build GPT-2 from scratch in PyTorch, step by step
PythonMITupdated Oct 28, 2026
Data from GitHub · snapshot Nov 13, 2026