Language Models
horseee/LLM-Pruner
[NeurIPS 2023] LLM-Pruner: On the Structural Pruning of Large Language Models. Support Llama-3/3.1, Llama-2, LLaMA, BLOOM, Vicuna, Baichuan, TinyLlama, etc.
PythonApache-2.0updated Oct 7, 2024
🏆 #1,979 overall#479 of 601 in Language Models
Picovoice /picollm
On-device LLM Inference Powered by X-Bit Quantization
$ git clone https://github.com/Picovoice/picollm.gitStars
318
318
Forks
27
27
Language
Python
License
Apache-2.0
Created
Apr 9, 2024
2.5 years old
Last push
Sep 11, 2026
More in Language Models
Language Models
hiyouga/LlamaFactory
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
🧠 Natural Language Processing
PythonApache-2.0updated Sep 14, 2026
Language Models
SqueezeAILab/LLMCompiler
[ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling
🧠 Natural Language Processing
PythonMITupdated Jul 10, 2024
Language Models
stochasticai/xTuring
Build, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6
PythonApache-2.0updated Sep 12, 2026
Language Models
darrenburns/elia
A snappy, keyboard-centric terminal user interface for interacting with large language models. Chat with ChatGPT, Claude, Llama 3, Phi 3, Mistral, Gemma and more.
PythonApache-2.0updated Oct 10, 2024
Language Models
RahulSChand/gpu_poor
Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization
JavaScriptno licenseupdated Dec 3, 2024
Data from GitHub · snapshot Sep 24, 2026