Language Models
SqueezeAILab/SqueezeLLM
[ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization
🧠 Natural Language Processing
PythonMITupdated Aug 13, 2024
🏆 #5,160 overall#1071 of 1,375 in Language Models
thu-nics /MoA
[CoLM'25] The official implementation of the paper <MoA: Mixture of Sparse Attention for Automatic Large Language Model Compression>
$ git clone https://github.com/thu-nics/MoA.gitStars
163
163
This week
—
Forks
9
9
Language
Python
License
MIT
Created
Jun 19, 2024
2.4 years old
Last push
Oct 9, 2026
Categories
More in Language Models
Language Models
SqueezeAILab/KVQuant
[NeurIPS 2024] KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization
🧠 Natural Language Processing
Pythonno licenseupdated Aug 13, 2024
Language Models
AIoT-MLSys-Lab/SVD-LLM
[ICLR 2025🔥] SVD-LLM & [NAACL 2025🔥] SVD-LLM V2
PythonApache-2.0updated Aug 28, 2025
Language Models
XunhaoLai/native-sparse-attention-triton
Efficient triton implementation of Native Sparse Attention.
🧠 Natural Language Processing
PythonApache-2.0updated May 23, 2025
Language Models
CASE-Lab-UMD/LLM-Drop
The official implementation of the paper "Uncovering the Redundancy in Transformers via a Unified Study of Layer Dropping (TMLR)".
🧠 Natural Language Processing
PythonApache-2.0updated Oct 2, 2026
Language Models
ByteDance-Seed/FlexPrefill
Code for paper: [ICLR2025 Oral] FlexPrefill: A Context-Aware Sparse Attention Mechanism for Efficient Long-Sequence Inference
🧠 Natural Language Processing
PythonApache-2.0updated Oct 13, 2025
Data from GitHub · snapshot Nov 13, 2026