🏆 #2,929 overall#664 of 1,375 in Language Models🔥 active this week

EfficientMoE /MoE-Infinity

PyTorch library for cost-effective, fast and easy serving of MoE models.

$ git clone https://github.com/EfficientMoE/MoE-Infinity.git
GitHub social preview for EfficientMoE/MoE-Infinity
Stars
382
382
This week
—
Forks
48
48
Language
Python
License
Apache-2.0
Created
Jan 22, 2024
2.8 years old
Last push
Nov 13, 2026
🔥 this week

Categories

GitHub topics

More in Language Models

Language Models

xLLM-AI/xllm🔥 active

▲ +4 ★ this week

A high-performance inference engine for LLM, VLM and DiT models, optimized for diverse AI accelerators. It is hosted in OpenAtom Foundation.

C++Apache-2.0updated Nov 13, 2026
GitHub ↗★ 1.6K⑂ 335
Language Models

AviSoori1x/makeMoE

From scratch implementation of a sparse mixture of experts language model inspired by Andrej Karpathy's makemore :)

Jupyter NotebookMITupdated Oct 30, 2024
GitHub ↗★ 821⑂ 96
Language Models

brontoguana/krasis🔥 active

Krasis is a Hybrid LLM runtime which focuses on efficient running of larger models on consumer grade VRAM limited hardware

C++Otherupdated Nov 12, 2026
GitHub ↗★ 529⑂ 33
Language Models

Dynamis-Labs/spectralquant

SpectralQuant: Calibrated Eigenbasis Rotation and Water-Filled Bit Allocation for KV-Cache Compression

PythonMITupdated May 15, 2026
GitHub ↗★ 204⑂ 24
Language Models

rickiepark/llm-from-scratch

<밑바닥부터 만들면서 공부하는 LLM>(길벗, 2025)의 코드 저장소

Jupyter NotebookApache-2.0updated Aug 8, 2026
GitHub ↗★ 136⑂ 134

Data from GitHub · snapshot Nov 13, 2026