🏆 #1,145 overall#258 of 1,378 in Language Models

RahulSChand /gpu_poor

Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization

$ git clone https://github.com/RahulSChand/gpu_poor.git
GitHub social preview for RahulSChand/gpu_poor
Stars
1.4K
1,405
This week
+3 ★
+5 this month
Forks
88
88
Language
JavaScript
License
None
Created
Sep 12, 2023
3.2 years old
Last push
Dec 3, 2024

Stars, last 30 days

Oct 15, 2026 → Nov 16, 2026
★ 1.4K▲ +6★ 1.4K

Categories

GitHub topics

More in Language Models

Language Models

RWKV/rwkv.cpp

▲ +1 ★ this week

INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model

C++MITupdated Mar 23, 2025
GitHub ↗★ 1.6K⑂ 130
Language Models

AI-Hypercomputer/JetStream

JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome).

PythonApache-2.0updated Jan 5, 2026
GitHub ↗★ 474⑂ 70

Data from GitHub · snapshot Nov 16, 2026