🏆 #159 overall#57 of 601 in Language Models

Tiiny-AI /PowerInfer

High-speed Large Language Model Serving for Local Deployment

$ git clone https://github.com/Tiiny-AI/PowerInfer.git
GitHub social preview for Tiiny-AI/PowerInfer
Stars
9.8K
9,805
Forks
601
601
Language
C++
License
MIT
Created
Dec 15, 2023
2.8 years old
Last push
May 11, 2026

Categories

GitHub topics

More in Language Models

Language Models

ray-project/ray🔥 active

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

PythonApache-2.0updated Sep 24, 2026
GitHub ↗★ 43.9K⑂ 8.1K
Language Models

ymcui/Chinese-LLaMA-Alpaca

中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

🧠 Natural Language Processing
PythonApache-2.0updated Apr 19, 2026
GitHub ↗★ 18.9K⑂ 1.8K
Language Models

Lightning-AI/litgpt

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

PythonApache-2.0updated Sep 14, 2026
GitHub ↗★ 13.7K⑂ 1.5K
Language Models

ymcui/Chinese-LLaMA-Alpaca-2

中文LLaMA-2 & Alpaca-2大模型二期项目 + 64K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models)

🧠 Natural Language Processing
PythonApache-2.0updated Apr 19, 2026
GitHub ↗★ 7.1K⑂ 558
Language Models

NVIDIA/GenerativeAIExamples

Generative AI reference workflows optimized for accelerated infrastructure and microservice architecture.

Jupyter NotebookApache-2.0updated Sep 9, 2026
GitHub ↗★ 4.2K⑂ 1.1K
Language Models

NVlabs/Eagle

Eagle: Frontier Vision-Language Models with Data-Centric Strategies

PythonApache-2.0updated Jun 24, 2026
GitHub ↗★ 3.6K⑂ 355

Data from GitHub · snapshot Sep 24, 2026