horseee/LLM-Pruner
[NeurIPS 2023] LLM-Pruner: On the Structural Pruning of Large Language Models. Support Llama-3/3.1, Llama-2, LLaMA, BLOOM, Vicuna, Baichuan, TinyLlama, etc.
On-device LLM Inference Powered by X-Bit Quantization
$ git clone https://github.com/Picovoice/picollm.git[NeurIPS 2023] LLM-Pruner: On the Structural Pruning of Large Language Models. Support Llama-3/3.1, Llama-2, LLaMA, BLOOM, Vicuna, Baichuan, TinyLlama, etc.
▲ +132 ★ this week
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
▲ +1 ★ this week
[ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling
[NeurIPS 2024] KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization
▲ +3 ★ this week
Build, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6
▲ +1 ★ this week
A snappy, keyboard-centric terminal user interface for interacting with large language models. Chat with ChatGPT, Claude, Llama 3, Phi 3, Mistral, Gemma and more.
Data from GitHub · snapshot Nov 16, 2026