🏆 #464 overall#143 of 2,559 in Natural Language Processing🔥 active this week

ModelTC /LightLLM

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

$ git clone https://github.com/ModelTC/LightLLM.git
GitHub social preview for ModelTC/LightLLM
Stars
4.4K
4,362
This week
+4 ★
+35 this month
Forks
389
389
Language
Python
License
Apache-2.0
Created
Jul 22, 2023
3.3 years old
Last push
Nov 16, 2026
🔥 this week

Stars, last 30 days

Oct 15, 2026 → Nov 16, 2026
★ 4.3K▲ +40★ 4.4K

Categories

GitHub topics

More in Natural Language Processing

Natural Language Processing

raiyanyahya/how-to-train-your-gpt

▲ +6 ★ this week

Build a modern LLM from scratch. Every line commented. Explained like we are five.

🤖 Language Models
Jupyter NotebookMITupdated Oct 26, 2026
GitHub ↗★ 4.2K⑂ 505
Natural Language Processing

theaniketgiri/create-llm

▲ +1 ★ this week

The fastest way to build and start training your own LLM. CLI tool that scaffolds production-ready PyTorch training projects in seconds. Like create-next-app but for language models.

🤖 Language Models
TypeScriptMITupdated Sep 13, 2026
GitHub ↗★ 373⑂ 49
Natural Language Processing

keith2018/TinyGPT

Tiny C++ LLM inference implementation from scratch

🤖 Language Models
C++MITupdated Jun 23, 2026
GitHub ↗★ 132⑂ 21
Natural Language Processing

leehanchung/SMILE-factory🔥 active

Finetune Falcon, LLaMA, MPT, and RedPajama on consumer hardware using PEFT LoRA

Jupyter NotebookApache-2.0updated Nov 15, 2026
GitHub ↗★ 106⑂ 16
Natural Language Processing

ymcui/Chinese-LLaMA-Alpaca

中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

🤖 Language Models
PythonApache-2.0updated Apr 19, 2026
GitHub ↗★ 18.9K⑂ 1.8K

Data from GitHub · snapshot Nov 16, 2026