🏆 #1,032 overall#234 of 1,378 in Language Models🔥 active this week

xLLM-AI /xllm

A high-performance inference engine for LLM, VLM and DiT models, optimized for diverse AI accelerators. It is hosted in OpenAtom Foundation.

$ git clone https://github.com/xLLM-AI/xllm.git
GitHub social preview for xLLM-AI/xllm
Stars
1.6K
1,623
This week
+5 ★
Forks
337
337
Language
C++
License
Apache-2.0
Created
Aug 12, 2025
1.3 years old
Last push
Nov 16, 2026
🔥 this week

Stars, last 17 days

Oct 28, 2026 → Nov 16, 2026
★ 1.6K▲ +14★ 1.6K

Categories

GitHub topics

More in Language Models

Language Models

GradientHQ/parallax

▲ +8 ★ this week

Parallax is a distributed model serving framework that lets you build your own AI cluster anywhere

PythonApache-2.0updated Jul 1, 2026
GitHub ↗★ 1.4K⑂ 154
Language Models

huawei-csl/SINQ

Welcome to the official repository of SINQ! A novel, fast and high-quality quantization method designed to make any Large Language Model smaller while preserving accuracy [ICML 2026]

PythonApache-2.0updated May 8, 2026
GitHub ↗★ 638⑂ 51
Language Models

brontoguana/krasis🔥 active

Krasis is a Hybrid LLM runtime which focuses on efficient running of larger models on consumer grade VRAM limited hardware

C++Otherupdated Nov 12, 2026
GitHub ↗★ 530⑂ 33
Language Models

AI-Hypercomputer/JetStream

JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome).

PythonApache-2.0updated Jan 5, 2026
GitHub ↗★ 474⑂ 70
Language Models

EfficientMoE/MoE-Infinity🔥 active

PyTorch library for cost-effective, fast and easy serving of MoE models.

PythonApache-2.0updated Nov 14, 2026
GitHub ↗★ 384⑂ 47
Language Models

hiyouga/LlamaFactory🔥 active

▲ +132 ★ this week

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

🧠 Natural Language Processing
PythonApache-2.0updated Nov 16, 2026
GitHub ↗★ 76.1K⑂ 9.4K

Data from GitHub · snapshot Nov 16, 2026