Language Models
SqueezeAILab/KVQuant
[NeurIPS 2024] KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization
🧠 Natural Language Processing
Pythonno licenseupdated Aug 13, 2024
[ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization
$ git clone https://github.com/SqueezeAILab/SqueezeLLM.git[NeurIPS 2024] KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization
[ICML 2024] KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache
[ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling
[NeurIPS 2024 Oral🔥] DuQuant: Distributing Outliers via Dual Transformation Makes Stronger Quantized LLMs.
STEPQuant: When and Where Errors Matter in Delta-Rule Recurrent State Quantization
▲ +27 ★ this week
The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.
Data from GitHub · snapshot Nov 13, 2026