✦ live from GitHub + arXiv ✦

Text Mining
TechOpen Source Text Mining Tools & NLP Libraries

by HackerNoon

The 7,039 most-starred open source tools, libraries and frameworks for digging meaning out of text.

7,039
repos
12.5M ★
stars mined
16
categories
100+
stars to get in

snapshot Nov 19, 2026 · archived repos & forks excluded

★ 169.3K huggingface/transformers★ 159.1K open-webui/open-webui★ 156.8K langflow-ai/langflow★ 150.5K Graphify-Labs/graphify★ 149.9K langchain-ai/langchain★ 123.9K microsoft/generative-ai-for-beginners★ 118.4K thedotmack/claude-mem★ 113.9K debpalash/VoiceStudio★ 108.7K rasbt/LLMs-from-scratch★ 94.4K infiniflow/ragflow★ 92.9K PaddlePaddle/PaddleOCR★ 87.6K unclecode/crawl4ai★ 87.4K datawhalechina/hello-agents★ 85.2K mlabonne/llm-course★ 84K opendatalab/MinerU★ 82.6K d2l-ai/d2l-zh★ 80.2K dair-ai/Prompt-Engineering-Guide★ 80.1K headroomlabs-ai/headroom★ 77.6K tesseract-ocr/tesseract★ 76.1K hiyouga/LlamaFactory★ 71.7K binary-husky/gpt_academic★ 71K microsoft/AI-For-Beginners★ 70.8K docling-project/docling★ 69.2K mem0ai/mem0
See all →
Speech Recognition

debpalash/VoiceStudio🔥 active

▲ +5K ★ this week

VoiceStudio is the open-source, fully-local ElevenLabs alternative — voice cloning, voice design, video dubbing, dictation, transcription & audiobook creation in 646 languages.

PythonAGPL-3.0updated Nov 18, 2026
GitHub ↗★ 113.9K⑂ 12.7K
Search & Retrieval

Graphify-Labs/graphify🔥 active

▲ +3.9K ★ this week

Turn any codebase, with its docs, SQL schemas, configs, and PDFs, into a queryable knowledge graph. A /graphify skill for Claude Code, Cursor, Codex, and Gemini CLI: local deterministic AST parsing, every edge explained, no vector store.

PythonApache-2.0updated Nov 17, 2026
GitHub ↗★ 150.5K⑂ 14.5K
Search & Retrieval

HKUDS/DeepTutor🔥 active

▲ +2.2K ★ this week

DeepTutor: Lifelong Personalized Tutoring. https://deeptutor.info/.

PythonApache-2.0updated Nov 18, 2026
GitHub ↗★ 60.7K⑂ 7.4K
Search & Retrieval

thedotmack/claude-mem🔥 active

▲ +1.9K ★ this week

Persistent Context Across Sessions for Every Agent – Captures everything your agent does during sessions, compresses it with AI, and injects relevant context back into future sessions. Works with Claude Code, OpenClaw, Codex, Gemini, Hermes, Copilot, OpenCode + More

TypeScriptApache-2.0updated Nov 19, 2026
GitHub ↗★ 118.4K⑂ 10.3K
Speech Recognition

anomalyco/hex🔥 active

▲ +1.1K ★ this week

Local voice dictation for mac, windows and linux

RustMITupdated Nov 19, 2026
GitHub ↗★ 7.5K⑂ 486
Search & Retrieval

bojieli/ai-agent-book

▲ +958 ★ this week

《深入理解 AI Agent:设计原理与工程实践》(李博杰 著)开源主仓库:全书正文、编译版 PDF 与按章配套代码

🤖 Language Models
PythonApache-2.0updated Oct 8, 2026
GitHub ↗★ 58.8K⑂ 6.9K

Pick a vein to mine →

1–24 of 7,039

Natural Language Processing🥇#1

huggingface/transformers🔥 active

▲ +357 ★ this week

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

🎙️ Speech Recognition
PythonApache-2.0updated Nov 19, 2026
GitHub ↗★ 169.3K⑂ 35.2K
Search & Retrieval🥈#2

open-webui/open-webui🔥 active

▲ +614 ★ this week

User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

SvelteOtherupdated Nov 19, 2026
GitHub ↗★ 159.1K⑂ 23.1K
Language Models🥉#3

langflow-ai/langflow🔥 active

▲ +207 ★ this week

Langflow is a powerful tool for building and deploying AI-powered agents and workflows.

PythonMITupdated Nov 19, 2026
GitHub ↗★ 156.8K⑂ 10.4K
Search & Retrieval#4

Graphify-Labs/graphify🔥 active

▲ +3.9K ★ this week

Turn any codebase, with its docs, SQL schemas, configs, and PDFs, into a queryable knowledge graph. A /graphify skill for Claude Code, Cursor, Codex, and Gemini CLI: local deterministic AST parsing, every edge explained, no vector store.

PythonApache-2.0updated Nov 17, 2026
GitHub ↗★ 150.5K⑂ 14.5K
Search & Retrieval#5

langchain-ai/langchain🔥 active

▲ +501 ★ this week

The agent engineering platform.

PythonMITupdated Nov 19, 2026
GitHub ↗★ 149.9K⑂ 25.2K
Search & Retrieval#6

microsoft/generative-ai-for-beginners🔥 active

▲ +448 ★ this week

21 Lessons, Get Started Building with Generative AI

🤖 Language Models
Jupyter NotebookMITupdated Nov 19, 2026
GitHub ↗★ 123.9K⑂ 66.7K
Search & Retrieval#7

thedotmack/claude-mem🔥 active

▲ +1.9K ★ this week

Persistent Context Across Sessions for Every Agent – Captures everything your agent does during sessions, compresses it with AI, and injects relevant context back into future sessions. Works with Claude Code, OpenClaw, Codex, Gemini, Hermes, Copilot, OpenCode + More

TypeScriptApache-2.0updated Nov 19, 2026
GitHub ↗★ 118.4K⑂ 10.3K
Speech Recognition#8

debpalash/VoiceStudio🔥 active

▲ +5K ★ this week

VoiceStudio is the open-source, fully-local ElevenLabs alternative — voice cloning, voice design, video dubbing, dictation, transcription & audiobook creation in 646 languages.

PythonAGPL-3.0updated Nov 18, 2026
GitHub ↗★ 113.9K⑂ 12.7K
Language Models#9

rasbt/LLMs-from-scratch

▲ +359 ★ this week

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

✂️ Tokenization & Preprocessing🧠 Natural Language Processing
Jupyter NotebookOtherupdated Nov 9, 2026
GitHub ↗★ 108.7K⑂ 16.8K
Search & Retrieval#10

infiniflow/ragflow🔥 active

▲ +347 ★ this week

RAGFlow is an agent-native database: a Retrieval-Augmented Generation (RAG) engine that grew into context infrastructure.

GoApache-2.0updated Nov 19, 2026
GitHub ↗★ 94.4K⑂ 11.4K
OCR & Documents#11

PaddlePaddle/PaddleOCR

▲ +267 ★ this week

Turn any PDF or image document into structured data for your AI. A powerful, lightweight OCR toolkit that bridges the gap between images/PDFs and LLMs. Supports 100+ languages.

🔍 Search & Retrieval
PythonApache-2.0updated Sep 16, 2026
GitHub ↗★ 92.9K⑂ 11.7K
Search & Retrieval#12

unclecode/crawl4ai🔥 active

▲ +291 ★ this week

Official Crawl4AI Cloud: a hosted web scraping, extraction, and search API for AI agents. Free API key, 1,000 credits a month, no card. Fully open source: this repo is the Apache-2.0 crawler that powers it, and you can self-host it.

PythonApache-2.0updated Nov 19, 2026
GitHub ↗★ 87.6K⑂ 9.1K
Search & Retrieval#13

datawhalechina/hello-agents🔥 active

▲ +576 ★ this week

📚 《从零开始构建智能体》——从零开始的智能体原理与实践教程

PythonOtherupdated Nov 13, 2026
GitHub ↗★ 87.4K⑂ 10.9K
Language Models#14

mlabonne/llm-course

▲ +86 ★ this week

Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.

OtherApache-2.0updated Feb 5, 2026
GitHub ↗★ 85.2K⑂ 9.9K
OCR & Documents#15

opendatalab/MinerU🔥 active

▲ +433 ★ this week

Transforms complex documents like PDFs and Office docs into LLM-ready markdown/JSON for your Agentic workflows.

PythonOtherupdated Nov 18, 2026
GitHub ↗★ 84K⑂ 7K
Natural Language Processing#16

d2l-ai/d2l-zh

▲ +99 ★ this week

《动手学深度学习》:面向中文读者、能运行、可讨论。中英文版被70多个国家的500多所大学用于教学。

PythonApache-2.0updated Jul 30, 2024
GitHub ↗★ 82.6K⑂ 12.5K
Search & Retrieval#17

dair-ai/Prompt-Engineering-Guide

▲ +195 ★ this week

🐙 Guides, papers, lessons, notebooks and resources for prompt engineering, context engineering, RAG, and AI Agents.

🤖 Language Models
MDXMITupdated Mar 11, 2026
GitHub ↗★ 80.2K⑂ 8.8K
Search & Retrieval#18

headroomlabs-ai/headroom🔥 active

▲ +690 ★ this week

Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.

PythonApache-2.0updated Nov 19, 2026
GitHub ↗★ 80.1K⑂ 6.3K
OCR & Documents#19

tesseract-ocr/tesseract🔥 active

▲ +105 ★ this week

Tesseract Open Source OCR Engine (main repository)

C++Apache-2.0updated Nov 19, 2026
GitHub ↗★ 77.6K⑂ 10.9K
Language Models#20

hiyouga/LlamaFactory🔥 active

▲ +124 ★ this week

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

🧠 Natural Language Processing
PythonApache-2.0updated Nov 19, 2026
GitHub ↗★ 76.1K⑂ 9.4K
Language Models#21

binary-husky/gpt_academic

▲ +37 ★ this week

为GPT/GLM等LLM大语言模型提供实用化交互接口,特别优化论文阅读/润色/写作体验,模块化设计,支持自定义快捷按钮&函数插件,支持Python和C++等项目剖析&自译解功能,PDF/LaTex论文翻译&总结功能,支持并行问询多种LLM模型,支持chatglm3等本地模型。接入通义千问, deepseekcoder, 讯飞星火, 文心一言, llama2, rwkv, claude2, moss等。

PythonGPL-3.0updated Jan 25, 2026
GitHub ↗★ 71.7K⑂ 8.3K
Natural Language Processing#22

microsoft/AI-For-Beginners🔥 active

▲ +293 ★ this week

12 Weeks, 24 Lessons, AI for All!

Jupyter NotebookMITupdated Nov 15, 2026
GitHub ↗★ 71K⑂ 13.8K
OCR & Documents#23

docling-project/docling🔥 active

▲ +300 ★ this week

Get your documents ready for gen AI

PythonMITupdated Nov 19, 2026
GitHub ↗★ 70.8K⑂ 5.4K
Search & Retrieval#24

mem0ai/mem0🔥 active

▲ +368 ★ this week

The Memory Layer for AI Agents - Drop-in memory infrastructure for AI agents and apps. Context that persists. Built for production.

PythonApache-2.0updated Nov 18, 2026
GitHub ↗★ 69.2K⑂ 8.2K

Browse by category

All categories →