adbar/trafilatura🔥 active
▲ +43 ★ this week
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
MinerU-HTML: An SLM-powered HTML main content extractor that outputs clean HTML bodies. Perfect for Deep Research Agents, RAG applications, and training data generation.
$ git clone https://github.com/opendatalab/MinerU-HTML.git▲ +43 ★ this week
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
A community-driven collection of RAG (Retrieval-Augmented Generation) frameworks, projects, and resources. Contribute and explore the evolving RAG ecosystem.
▲ +3 ★ this week
WikiChat is an improved RAG. It stops the hallucination of large language models by retrieving data from a corpus.
Unify Efficient Fine-tuning of RAG Retrieval, including Embedding, ColBERT, ReRanker.
▲ +1 ★ this week
📚 Process PDFs, Word documents and more with spaCy
Use late-interaction multi-modal models such as ColPali in just a few lines of code.
Data from GitHub · snapshot Nov 13, 2026