🏆 #2,738 overall#637 of 1,507 in Search & Retrieval

messkan /prompt-cache

Cut LLM costs by up to 80% and unlock sub-millisecond responses with intelligent semantic caching.A drop-in, provider-agnostic LLM proxy written in Go with sub-millisecond response

$ git clone https://github.com/messkan/prompt-cache.git
GitHub social preview for messkan/prompt-cache
Stars
427
427
This week
+1 ★
-1 this month
Forks
44
44
Language
Go
License
MIT
Created
Nov 22, 2025
1.0 years old
Last push
Aug 18, 2026

Stars, last 30 days

Oct 15, 2026 → Nov 16, 2026
★ 428▼ 1★ 427

Categories

GitHub topics

More in Search & Retrieval

Search & Retrieval

NirDiamant/RAG_Techniques

▲ +112 ★ this week

This repository showcases various advanced techniques for Retrieval-Augmented Generation (RAG) systems. Each technique has a detailed notebook tutorial.

🧠 Natural Language Processing
Jupyter NotebookOtherupdated Nov 2, 2026
GitHub ↗★ 30.4K⑂ 3.7K
Search & Retrieval

NirDiamant/GenAI_Agents

50+ tutorials and implementations for Generative AI Agent techniques, from basic conversational bots to complex multi-agent systems.

Jupyter NotebookOtherupdated Nov 2, 2026
GitHub ↗★ 25K⑂ 4.2K
Search & Retrieval

StarTrail-org/LEANN🔥 active

[MLsys2026 Best Paper]: https://arxiv.org/abs/2506.08276. RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, accurate, and 100% private RAG application on your personal device.

PythonMITupdated Nov 11, 2026
GitHub ↗★ 13.8K⑂ 1.3K
Search & Retrieval

datawhalechina/all-in-rag🔥 active

🔍大模型应用开发实战一:RAG 技术全栈指南,在线阅读地址:https://datawhalechina.github.io/all-in-rag/

Pythonno licenseupdated Nov 16, 2026
GitHub ↗★ 13.2K⑂ 6.7K
Search & Retrieval

MemTensor/MemOS🔥 active

Self-evolving memory OS for LLM & AI Agents: ultra-persistent memory, hybrid-retrieval, and cross-task skill reuse, with 35.24% token savings and DeepSeek Harness support.

TypeScriptApache-2.0updated Nov 11, 2026
GitHub ↗★ 12.4K⑂ 1.1K
Search & Retrieval

sigoden/aichat

All-in-one LLM CLI tool featuring Shell Assistant, Chat-REPL, RAG, AI Tools & Agents, with access to OpenAI, Claude, Gemini, Ollama, Groq, and more.

RustApache-2.0updated Feb 23, 2026
GitHub ↗★ 10.6K⑂ 755

Data from GitHub · snapshot Nov 16, 2026