🏆 #2,319 overall#525 of 1,375 in Language Models

FMInference /H2O

[NeurIPS'23] H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models.

$ git clone https://github.com/FMInference/H2O.git
GitHub social preview for FMInference/H2O
Stars
541
541
This week
—
Forks
92
92
Language
Python
License
None
Created
Jun 12, 2023
3.4 years old
Last push
Aug 1, 2024

Categories

GitHub topics

More in Language Models

Language Models

trigaten/Learn_Prompting

▲ +2 ★ this week

Prompt Engineering, Generative AI, and LLM Guide by Learn Prompting | Join our discord for the largest Prompt Engineering learning community

🧠 Natural Language Processing
MDXOtherupdated Jan 14, 2025
GitHub ↗★ 4.7K⑂ 655
Language Models

promptslab/Promptify

▲ +1 ★ this week

Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models to get structured output. Join our discord for Prompt-Engineering, LLMs and other latest research

🧠 Natural Language Processing
PythonApache-2.0updated Mar 27, 2026
GitHub ↗★ 4.6K⑂ 362
Language Models

amazon-science/auto-cot

Official implementation for "Automatic Chain of Thought Prompting in Large Language Models" (stay tuned & more will be updated)

Jupyter NotebookApache-2.0updated Mar 13, 2024
GitHub ↗★ 2.1K⑂ 192
Language Models

explosion/spacy-llm

🦙 Integrating LLMs into structured NLP pipelines

🧠 Natural Language Processing🏷️ Named Entity Recognition🗂️ Text Classification
PythonMITupdated Oct 23, 2026
GitHub ↗★ 1.4K⑂ 111
Language Models

NVIDIA/kvpress🔥 active

▲ +7 ★ this week

LLM KV cache compression made easy

PythonApache-2.0updated Nov 11, 2026
GitHub ↗★ 1.3K⑂ 199

Data from GitHub · snapshot Nov 13, 2026