🏆 #6,672 overall#1426 of 1,494 in Search & Retrieval

Aavache /LLMWebCrawler

A Web Crawler based on LLMs implemented with Ray and Huggingface. The embeddings are saved into a vector database for fast clustering and retrieval. Use it for your RAG.

$ git clone https://github.com/Aavache/LLMWebCrawler.git
GitHub social preview for Aavache/LLMWebCrawler
Stars
107
107
This week
—
Forks
13
13
Language
Python
License
None
Created
Sep 28, 2023
3.1 years old
Last push
Oct 15, 2023

Categories

GitHub topics

More in Search & Retrieval

Search & Retrieval

Andrew-Jang/RAGHub

A community-driven collection of RAG (Retrieval-Augmented Generation) frameworks, projects, and resources. Contribute and explore the evolving RAG ecosystem.

🧠 Natural Language Processing🤖 Language Models
OtherMITupdated Jul 28, 2026
GitHub ↗★ 2K⑂ 192
Search & Retrieval

neuml/rag

🚀 Retrieval Augmented Generation (RAG) with txtai. Combine search and LLMs to find insights with your own data.

🤖 Language Models🧠 Natural Language Processing
PythonApache-2.0updated Jun 5, 2026
GitHub ↗★ 467⑂ 41
Search & Retrieval

neuml/txtchat

⚡ Local chat assistants with AI superpowers

🤖 Language Models🧠 Natural Language Processing
PythonApache-2.0updated Feb 13, 2026
GitHub ↗★ 340⑂ 24
Search & Retrieval

RCGAI/SimplyRetrieve

Lightweight chat AI platform featuring custom knowledge, open-source LLMs, prompt-engineering, retrieval analysis. Highly customizable. For Retrieval-Centric & Retrieval-Augmented Generation.

🧠 Natural Language Processing🤖 Language Models
PythonMITupdated Sep 21, 2026
GitHub ↗★ 217⑂ 14
Search & Retrieval

Renumics/renumics-rag🔥 active

Visualization for a Retrieval-Augmented Generation (RAG) Assistant 🤖❤️📚

🤖 Language Models
PythonMITupdated Nov 13, 2026
GitHub ↗★ 211⑂ 42
Search & Retrieval

neuml/txtai🔥 active

▲ +310 ★ this week

💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows

🤖 Language Models🧬 Embeddings🧠 Natural Language Processing
PythonApache-2.0updated Nov 13, 2026
GitHub ↗★ 13.4K⑂ 1K

Data from GitHub · snapshot Nov 13, 2026