๐Ÿ† #1,204 overall#352 of 601 in Language Models

AviSoori1x /makeMoE

From scratch implementation of a sparse mixture of experts language model inspired by Andrej Karpathy's makemore :)

$ git clone https://github.com/AviSoori1x/makeMoE.git
GitHub social preview for AviSoori1x/makeMoE
Stars
816
816
Forks
96
96
Language
Jupyter Notebook
License
MIT
Created
Jan 22, 2024
2.7 years old
Last push
Oct 30, 2024

Categories

GitHub topics

More in Language Models

Language Models

ray-project/ray๐Ÿ”ฅ active

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

PythonApache-2.0updated Sep 24, 2026
GitHub โ†—โ˜… 43.9Kโ‘‚ 8.1K
Language Models

NVIDIA/DeepLearningExamples

State-of-the-Art Deep Learning scripts organized by models - easy to train and deploy with reproducible accuracy and performance on enterprise-grade infrastructure.

๐ŸŽ™๏ธ Speech Recognition๐Ÿง  Natural Language Processing
Jupyter Notebookno licenseupdated Aug 12, 2024
GitHub โ†—โ˜… 14.9Kโ‘‚ 3.4K
Language Models

Lightning-AI/litgpt

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

PythonApache-2.0updated Sep 14, 2026
GitHub โ†—โ˜… 13.7Kโ‘‚ 1.5K
Language Models

activeloopai/deeplake

Deeplake is AI Data Runtime for Agents. It provides serverless postgres with a multimodal datalake, enabling scalable retrieval and training.

C++Apache-2.0updated May 21, 2026
GitHub โ†—โ˜… 9.2Kโ‘‚ 724

Data from GitHub ยท snapshot Sep 24, 2026