🏆 #294 overall#107 of 1,507 in Search & Retrieval🔥 active this week

adbar /trafilatura

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

$ git clone https://github.com/adbar/trafilatura.git
GitHub social preview for adbar/trafilatura
Stars
7.1K
7,137
This week
+43 ★
+160 this month
Forks
510
510
Language
Python
License
Apache-2.0
Created
Apr 8, 2019
7.6 years old
Last push
Nov 16, 2026
🔥 this week

Stars, last 30 days

Oct 15, 2026 → Nov 16, 2026
★ 7K▲ +166★ 7.1K

Categories

GitHub topics

More in Search & Retrieval

Search & Retrieval

lightfeed/extractor

Use LLMs to robustly extract web data

🧠 Natural Language Processing
TypeScriptApache-2.0updated Jun 6, 2026
GitHub ↗★ 322⑂ 10
Search & Retrieval

opendatalab/MinerU-HTML

MinerU-HTML: An SLM-powered HTML main content extractor that outputs clean HTML bodies. Perfect for Deep Research Agents, RAG applications, and training data generation.

🧠 Natural Language Processing
PythonApache-2.0updated Nov 6, 2026
GitHub ↗★ 301⑂ 28
Search & Retrieval

artitw/text2text

▲ +1 ★ this week

Text2Text Language Modeling Toolkit

✂️ Tokenization & Preprocessing🧠 Natural Language Processing
PythonOtherupdated Jan 14, 2025
GitHub ↗★ 306⑂ 40
Search & Retrieval

gil-son/language-ai-engineering-lab

▲ +1 ★ this week

Language AI Engineering Lab, a place where you can deeply understand and build modern Language AI systems, from fundamentals to production.

✂️ Tokenization & Preprocessing🧠 Natural Language Processing
Jupyter NotebookGPL-3.0updated Nov 1, 2026
GitHub ↗★ 130⑂ 27
Search & Retrieval

neuml/txtai🔥 active

▲ +300 ★ this week

💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows

🤖 Language Models🧬 Embeddings🧠 Natural Language Processing
PythonApache-2.0updated Nov 13, 2026
GitHub ↗★ 13.4K⑂ 1K
Search & Retrieval

milvus-io/bootcamp

▲ +2 ★ this week

Dealing with all unstructured data, such as reverse image search, audio search, molecular search, video analysis, question and answer systems, NLP, etc.

❓ Question Answering🧠 Natural Language Processing
Jupyter NotebookApache-2.0updated Oct 21, 2026
GitHub ↗★ 2.5K⑂ 683

Data from GitHub · snapshot Nov 16, 2026