🏆 #2,679 overall#603 of 1,375 in Language Models

jy-yuan /KIVI

[ICML 2024] KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache

$ git clone https://github.com/jy-yuan/KIVI.git
GitHub social preview for jy-yuan/KIVI
Stars
439
439
This week
—
Forks
58
58
Language
Python
License
MIT
Created
Feb 2, 2024
2.8 years old
Last push
Nov 20, 2025

Categories

GitHub topics

More in Language Models

Language Models

SqueezeAILab/SqueezeLLM

[ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization

🧠 Natural Language Processing
PythonMITupdated Aug 13, 2024
GitHub ↗★ 724⑂ 54
Language Models

young-geng/EasyLM

Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.

🧠 Natural Language Processing
PythonApache-2.0updated Aug 13, 2024
GitHub ↗★ 2.5K⑂ 262
Language Models

AI-Hypercomputer/JetStream

JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome).

PythonApache-2.0updated Jan 5, 2026
GitHub ↗★ 473⑂ 70
Language Models

QwenLM/Qwen

▲ +27 ★ this week

The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.

🧠 Natural Language Processing
PythonApache-2.0updated Mar 5, 2026
GitHub ↗★ 22K⑂ 2K
Language Models

ymcui/Chinese-LLaMA-Alpaca

中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

🧠 Natural Language Processing
PythonApache-2.0updated Apr 19, 2026
GitHub ↗★ 18.9K⑂ 1.8K

Data from GitHub · snapshot Nov 13, 2026