🏆 #2,688 overall#606 of 1,375 in Language Models

SqueezeAILab /KVQuant

[NeurIPS 2024] KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization

$ git clone https://github.com/SqueezeAILab/KVQuant.git
GitHub social preview for SqueezeAILab/KVQuant
Stars
437
437
This week
—
Forks
49
49
Language
Python
License
None
Created
Jan 31, 2024
2.8 years old
Last push
Aug 13, 2024

Categories

GitHub topics

More in Language Models

Language Models

SqueezeAILab/SqueezeLLM

[ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization

🧠 Natural Language Processing
PythonMITupdated Aug 13, 2024
GitHub ↗★ 724⑂ 54
Language Models

SqueezeAILab/LLMCompiler

[ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling

🧠 Natural Language Processing
PythonMITupdated Jul 10, 2024
GitHub ↗★ 1.9K⑂ 140
Language Models

darrenburns/elia

A snappy, keyboard-centric terminal user interface for interacting with large language models. Chat with ChatGPT, Claude, Llama 3, Phi 3, Mistral, Gemma and more.

PythonApache-2.0updated Oct 10, 2024
GitHub ↗★ 2.5K⑂ 156
Language Models

ymcui/Chinese-LLaMA-Alpaca

中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

🧠 Natural Language Processing
PythonApache-2.0updated Apr 19, 2026
GitHub ↗★ 18.9K⑂ 1.8K
Language Models

ymcui/Chinese-LLaMA-Alpaca-2

▲ +1 ★ this week

中文LLaMA-2 & Alpaca-2大模型二期项目 + 64K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models)

🧠 Natural Language Processing
PythonApache-2.0updated Apr 19, 2026
GitHub ↗★ 7.1K⑂ 557
Language Models

ymcui/Chinese-LLaMA-Alpaca-3

中文羊驼大模型三期项目 (Chinese Llama-3 LLMs) developed from Meta Llama 3

🧠 Natural Language Processing
PythonApache-2.0updated Apr 19, 2026
GitHub ↗★ 2K⑂ 167

Data from GitHub · snapshot Nov 13, 2026