Language Models
xLLM-AI/xllm🔥 active
▲ +4 ★ this week
A high-performance inference engine for LLM, VLM and DiT models, optimized for diverse AI accelerators. It is hosted in OpenAtom Foundation.
C++Apache-2.0updated Nov 13, 2026
🏆 #2,364 overall#532 of 1,375 in Language Models🔥 active this week
brontoguana /krasis
Krasis is a Hybrid LLM runtime which focuses on efficient running of larger models on consumer grade VRAM limited hardware
$ git clone https://github.com/brontoguana/krasis.gitStars
529
529
This week
—
Forks
33
33
Language
C++
License
Other
Created
Feb 9, 2026
0.8 years old
Last push
Nov 12, 2026
🔥 this week
Categories
More in Language Models
Language Models
amitshekhariitbhu/llm-inference-engineering🔥 active
Learn LLM Inference Engineering step by step - from KV cache, PagedAttention, and continuous batching to vLLM, SGLang, and GPUs.
MarkdownApache-2.0updated Nov 9, 2026
Language Models
EfficientMoE/MoE-Infinity🔥 active
PyTorch library for cost-effective, fast and easy serving of MoE models.
PythonApache-2.0updated Nov 13, 2026
Language Models
ray-project/ray🔥 active
▲ +60 ★ this week
Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
PythonApache-2.0updated Nov 13, 2026
Language Models
Lightning-AI/litgpt🔥 active
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
PythonApache-2.0updated Nov 10, 2026
Language Models
Tiiny-AI/PowerInfer
▲ +13 ★ this week
High-speed Large Language Model Serving for Local Deployment
C++MITupdated May 11, 2026
Data from GitHub · snapshot Nov 13, 2026