🏆 #2,939 overall#672 of 1,494 in Search & Retrieval

dusty-nv /NanoLLM

Optimized local inference for LLMs with HuggingFace-like APIs for quantization, vision/language models, multimodal agents, speech, vector DB, and RAG.

$ git clone https://github.com/dusty-nv/NanoLLM.git
GitHub social preview for dusty-nv/NanoLLM
Stars
380
380
This week
—
Forks
67
67
Language
Python
License
MIT
Created
Mar 31, 2024
2.6 years old
Last push
Oct 18, 2024

Categories

GitHub topics

More in Search & Retrieval

Search & Retrieval

genkit-ai/genkit🔥 active

Open-source framework for building agentic apps in JavaScript, Go, Dart, and Python, built and used in production by Google

TypeScriptApache-2.0updated Nov 13, 2026
GitHub ↗★ 6.6K⑂ 880
Search & Retrieval

run-llama/llama_index🔥 active

LlamaIndex is the document processing platform for AI

PythonMITupdated Nov 13, 2026
GitHub ↗★ 52.9K⑂ 8.6K
Search & Retrieval

StarTrail-org/PixelRAG🔥 active

https://arxiv.org/abs/2606.28344. The end of web parsing. The beginning of scalable pixel-native search. link: https://pixelrag.ai/

PythonApache-2.0updated Nov 11, 2026
GitHub ↗★ 10.9K⑂ 985
Search & Retrieval

NVIDIA/GenerativeAIExamples

▲ +7 ★ this week

Generative AI reference workflows optimized for accelerated infrastructure and microservice architecture.

🤖 Language Models
Jupyter NotebookApache-2.0updated Nov 6, 2026
GitHub ↗★ 4.2K⑂ 1.1K

Data from GitHub · snapshot Nov 13, 2026