Language Models
dvmazur/mixtral-offloading
Run Mixtral-8x7B models in Colab or consumer desktops
PythonMITupdated Apr 8, 2024
🏆 #5,123 overall#1065 of 1,375 in Language Models
LINs-lab /DynMoE
[ICLR 2025] Dynamic Mixture of Experts: An Auto-Tuning Approach for Efficient Transformer Models
$ git clone https://github.com/LINs-lab/DynMoE.gitStars
165
165
This week
—
Forks
20
20
Language
Python
License
Apache-2.0
Created
May 17, 2024
2.5 years old
Last push
Jul 9, 2025
Categories
More in Language Models
Language Models
ymcui/Chinese-Mixtral
中文Mixtral混合专家大模型（Chinese Mixtral MoE LLMs）
🧠 Natural Language Processing
PythonApache-2.0updated Apr 19, 2026
Language Models
SkyworkAI/MoE-plus-plus
[ICLR 2025] MoE++: Accelerating Mixture-of-Experts Methods with Zero-Computation Experts
PythonApache-2.0updated Oct 16, 2024
Language Models
shufangxun/LLaVA-MoD
[ICLR 2025] LLaVA-MoD: Making LLaVA Tiny via MoE-Knowledge Distillation
PythonApache-2.0updated Mar 31, 2025
Language Models
psmarter/mini-infer
▲ +1 ★ this week
LLM inference engine from scratch — paged KV cache, continuous batching, chunked prefill, prefix caching, speculative decoding, CUDA graph, tensor parallelism, OpenAI-compatible serving
PythonMITupdated Apr 24, 2026
Language Models
microsoft/generative-ai-for-beginners🔥 active
▲ +393 ★ this week
21 Lessons, Get Started Building with Generative AI
🔍 Search & Retrieval
Jupyter NotebookMITupdated Nov 12, 2026
Data from GitHub · snapshot Nov 13, 2026