Language Models
🏆 #1,145 overall#258 of 1,378 in Language Models
RahulSChand /gpu_poor
Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization
$ git clone https://github.com/RahulSChand/gpu_poor.gitStars
1.4K
1,405
This week
+3 ★
+5 this month
Forks
88
88
Language
JavaScript
License
None
Created
Sep 12, 2023
3.2 years old
Last push
Dec 3, 2024
Stars, last 30 days
Oct 15, 2026 → Nov 16, 2026Categories
More in Language Models
Language Models
nathanlesage/local-chat
LocalChat is a ChatGPT-like chat that runs on your computer
TypeScriptGPL-3.0updated Jan 4, 2025
Language Models
dvmazur/mixtral-offloading
Run Mixtral-8x7B models in Colab or consumer desktops
PythonMITupdated Apr 8, 2024
Language Models
RWKV/rwkv.cpp
▲ +1 ★ this week
INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
C++MITupdated Mar 23, 2025
Language Models
AI-Hypercomputer/JetStream
JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome).
PythonApache-2.0updated Jan 5, 2026
Language Models
Data from GitHub · snapshot Nov 16, 2026