🏆 #1,694 overall#378 of 1,378 in Language Models

AviSoori1x /makeMoE

From scratch implementation of a sparse mixture of experts language model inspired by Andrej Karpathy's makemore :)

$ git clone https://github.com/AviSoori1x/makeMoE.git
GitHub social preview for AviSoori1x/makeMoE
Stars
821
821
This week
0 ★
Forks
96
96
Language
Jupyter Notebook
License
MIT
Created
Jan 22, 2024
2.8 years old
Last push
Oct 30, 2024

Stars, last 17 days

Oct 28, 2026 → Nov 16, 2026
★ 820▲ +1★ 821

Categories

GitHub topics

More in Language Models

Language Models

AviSoori1x/seemore

From scratch implementation of a vision language model in pure PyTorch

Jupyter NotebookMITupdated May 6, 2024
GitHub ↗★ 263⑂ 31
Language Models

aa1143/NamiGPT

零基础入门大模型(LLM)的基础教程:从零手写 GPT-2,一行行看懂大模型是怎么工作的 | Build GPT-2 from scratch in PyTorch, step by step

PythonMITupdated Oct 28, 2026
GitHub ↗★ 237⑂ 24
Language Models

rickiepark/llm-from-scratch

<밑바닥부터 만들면서 공부하는 LLM>(길벗, 2025)의 코드 저장소

Jupyter NotebookApache-2.0updated Aug 8, 2026
GitHub ↗★ 137⑂ 134

Data from GitHub · snapshot Nov 16, 2026