🏆 #325 overall#139 of 1,075 in Natural Language Processing🔥 active this week

ModelTC /LightLLM

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

$ git clone https://github.com/ModelTC/LightLLM.git
GitHub social preview for ModelTC/LightLLM
Stars
4.3K
4,299
Forks
367
367
Language
Python
License
Apache-2.0
Created
Jul 22, 2023
3.2 years old
Last push
Sep 24, 2026
🔥 this week

Categories

GitHub topics

More in Natural Language Processing

Natural Language Processing

raiyanyahya/how-to-train-your-gpt

Build a modern LLM from scratch. Every line commented. Explained like we are five.

🤖 Language Models
Jupyter NotebookMITupdated Aug 30, 2026
GitHub ↗★ 3.4K⑂ 419
Natural Language Processing

theaniketgiri/create-llm

The fastest way to build and start training your own LLM. CLI tool that scaffolds production-ready PyTorch training projects in seconds. Like create-next-app but for language models.

🤖 Language Models
TypeScriptMITupdated Sep 13, 2026
GitHub ↗★ 365⑂ 48
Natural Language Processing

ymcui/Chinese-LLaMA-Alpaca

中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

🤖 Language Models
PythonApache-2.0updated Apr 19, 2026
GitHub ↗★ 18.9K⑂ 1.8K
Natural Language Processing

botpress/botpress🔥 active

The open-source hub to build & deploy GPT/LLM Agents ⚡️

TypeScriptMITupdated Sep 23, 2026
GitHub ↗★ 14.9K⑂ 2.3K
Natural Language Processing

bigscience-workshop/petals

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

🤖 Language Models
PythonMITupdated Sep 7, 2024
GitHub ↗★ 10.6K⑂ 651

Data from GitHub · snapshot Sep 24, 2026