✦ live from GitHub + arXiv ✦

Text Mining
TechOpen Source Text Mining Tools & NLP Libraries

by HackerNoon

The 7,053 most-starred open source tools, libraries and frameworks for digging meaning out of text.

7,053
repos
12.6M ★
stars mined
16
categories
100+
stars to get in

snapshot Nov 21, 2026 · archived repos & forks excluded

★ 169.3K huggingface/transformers★ 159.2K open-webui/open-webui★ 156.8K langflow-ai/langflow★ 151.5K Graphify-Labs/graphify★ 150K langchain-ai/langchain★ 123.9K microsoft/generative-ai-for-beginners★ 118.8K thedotmack/claude-mem★ 115.8K debpalash/VoiceStudio★ 108.7K rasbt/LLMs-from-scratch★ 94.5K infiniflow/ragflow★ 93K PaddlePaddle/PaddleOCR★ 87.6K unclecode/crawl4ai★ 87.6K datawhalechina/hello-agents★ 85.2K mlabonne/llm-course★ 84.1K opendatalab/MinerU★ 82.6K d2l-ai/d2l-zh★ 80.3K dair-ai/Prompt-Engineering-Guide★ 80.2K headroomlabs-ai/headroom★ 77.6K tesseract-ocr/tesseract★ 76.2K hiyouga/LlamaFactory★ 71.7K binary-husky/gpt_academic★ 71.1K microsoft/AI-For-Beginners★ 70.8K docling-project/docling★ 69.3K mem0ai/mem0
See all →
Speech Recognition

debpalash/VoiceStudio🔥 active

▲ +5.4K ★ this week

VoiceStudio is the open-source, fully-local ElevenLabs alternative — voice cloning, voice design, video dubbing, dictation, transcription & audiobook creation in 646 languages.

PythonAGPL-3.0updated Nov 21, 2026
GitHub ↗★ 115.8K⑂ 12.9K
Search & Retrieval

Graphify-Labs/graphify🔥 active

▲ +4K ★ this week

Turn any codebase, with its docs, SQL schemas, configs, and PDFs, into a queryable knowledge graph. A /graphify skill for Claude Code, Cursor, Codex, and Gemini CLI: local deterministic AST parsing, every edge explained, no vector store.

PythonApache-2.0updated Nov 20, 2026
GitHub ↗★ 151.5K⑂ 14.6K
Search & Retrieval

HKUDS/DeepTutor🔥 active

▲ +2.1K ★ this week

DeepTutor: Lifelong Personalized Tutoring. https://deeptutor.info/.

PythonApache-2.0updated Nov 20, 2026
GitHub ↗★ 61.3K⑂ 7.4K
Search & Retrieval

thedotmack/claude-mem🔥 active

▲ +1.8K ★ this week

Persistent Context Across Sessions for Every Agent – Captures everything your agent does during sessions, compresses it with AI, and injects relevant context back into future sessions. Works with Claude Code, OpenClaw, Codex, Gemini, Hermes, Copilot, OpenCode + More

TypeScriptApache-2.0updated Nov 21, 2026
GitHub ↗★ 118.8K⑂ 10.3K
Speech Recognition

FrigadeHQ/yogurt🔥 active

▲ +1.5K ★ this week

Private AI meeting notes that stay on your computer. No meeting bot. Free and open source for Mac, Windows and Linux. An alternative to Granola, Otter and Fireflies.

TypeScriptMITupdated Nov 21, 2026
GitHub ↗★ 2.8K⑂ 237
Speech Recognition

anomalyco/hex🔥 active

▲ +1.2K ★ this week

Local voice dictation for mac, windows and linux

RustMITupdated Nov 21, 2026
GitHub ↗★ 7.9K⑂ 517

Pick a vein to mine →

1–24 of 7,053

Natural Language Processing🥇#1

huggingface/transformers🔥 active

▲ +379 ★ this week

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

🎙️ Speech Recognition
PythonApache-2.0updated Nov 21, 2026
GitHub ↗★ 169.3K⑂ 35.3K
Search & Retrieval🥈#2

open-webui/open-webui🔥 active

▲ +568 ★ this week

User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

SvelteOtherupdated Nov 21, 2026
GitHub ↗★ 159.2K⑂ 23.1K
Language Models🥉#3

langflow-ai/langflow🔥 active

▲ +193 ★ this week

Langflow is a powerful tool for building and deploying AI-powered agents and workflows.

PythonMITupdated Nov 21, 2026
GitHub ↗★ 156.8K⑂ 10.4K
Search & Retrieval#4

Graphify-Labs/graphify🔥 active

▲ +4K ★ this week

Turn any codebase, with its docs, SQL schemas, configs, and PDFs, into a queryable knowledge graph. A /graphify skill for Claude Code, Cursor, Codex, and Gemini CLI: local deterministic AST parsing, every edge explained, no vector store.

PythonApache-2.0updated Nov 20, 2026
GitHub ↗★ 151.5K⑂ 14.6K
Search & Retrieval#5

langchain-ai/langchain🔥 active

▲ +503 ★ this week

The agent engineering platform.

PythonMITupdated Nov 21, 2026
GitHub ↗★ 150K⑂ 25.2K
Search & Retrieval#6

microsoft/generative-ai-for-beginners🔥 active

▲ +465 ★ this week

21 Lessons, Get Started Building with Generative AI

🤖 Language Models
Jupyter NotebookMITupdated Nov 19, 2026
GitHub ↗★ 123.9K⑂ 66.8K
Search & Retrieval#7

thedotmack/claude-mem🔥 active

▲ +1.8K ★ this week

Persistent Context Across Sessions for Every Agent – Captures everything your agent does during sessions, compresses it with AI, and injects relevant context back into future sessions. Works with Claude Code, OpenClaw, Codex, Gemini, Hermes, Copilot, OpenCode + More

TypeScriptApache-2.0updated Nov 21, 2026
GitHub ↗★ 118.8K⑂ 10.3K
Speech Recognition#8

debpalash/VoiceStudio🔥 active

▲ +5.4K ★ this week

VoiceStudio is the open-source, fully-local ElevenLabs alternative — voice cloning, voice design, video dubbing, dictation, transcription & audiobook creation in 646 languages.

PythonAGPL-3.0updated Nov 21, 2026
GitHub ↗★ 115.8K⑂ 12.9K
Language Models#9

rasbt/LLMs-from-scratch🔥 active

▲ +349 ★ this week

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

✂️ Tokenization & Preprocessing🧠 Natural Language Processing
Jupyter NotebookOtherupdated Nov 20, 2026
GitHub ↗★ 108.7K⑂ 16.8K
Search & Retrieval#10

infiniflow/ragflow🔥 active

▲ +364 ★ this week

RAGFlow is an agent-native database: a Retrieval-Augmented Generation (RAG) engine that grew into context infrastructure.

GoApache-2.0updated Nov 21, 2026
GitHub ↗★ 94.5K⑂ 11.4K
OCR & Documents#11

PaddlePaddle/PaddleOCR

▲ +282 ★ this week

Turn any PDF or image document into structured data for your AI. A powerful, lightweight OCR toolkit that bridges the gap between images/PDFs and LLMs. Supports 100+ languages.

🔍 Search & Retrieval
PythonApache-2.0updated Sep 16, 2026
GitHub ↗★ 93K⑂ 11.7K
Search & Retrieval#12

unclecode/crawl4ai🔥 active

▲ +286 ★ this week

Official Crawl4AI Cloud: a hosted web scraping, extraction, and search API for AI agents. Free API key, 1,000 credits a month, no card. Fully open source: this repo is the Apache-2.0 crawler that powers it, and you can self-host it.

PythonApache-2.0updated Nov 20, 2026
GitHub ↗★ 87.6K⑂ 9.1K
Search & Retrieval#13

datawhalechina/hello-agents

▲ +586 ★ this week

📚 《从零开始构建智能体》——从零开始的智能体原理与实践教程

PythonOtherupdated Nov 13, 2026
GitHub ↗★ 87.6K⑂ 10.9K
Language Models#14

mlabonne/llm-course

▲ +70 ★ this week

Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.

OtherApache-2.0updated Feb 5, 2026
GitHub ↗★ 85.2K⑂ 9.9K
OCR & Documents#15

opendatalab/MinerU🔥 active

▲ +433 ★ this week

Transforms complex documents like PDFs and Office docs into LLM-ready markdown/JSON for your Agentic workflows.

PythonOtherupdated Nov 20, 2026
GitHub ↗★ 84.1K⑂ 6.9K
Natural Language Processing#16

d2l-ai/d2l-zh

▲ +112 ★ this week

《动手学深度学习》:面向中文读者、能运行、可讨论。中英文版被70多个国家的500多所大学用于教学。

PythonApache-2.0updated Jul 30, 2024
GitHub ↗★ 82.6K⑂ 12.5K
Search & Retrieval#17

dair-ai/Prompt-Engineering-Guide

▲ +220 ★ this week

🐙 Guides, papers, lessons, notebooks and resources for prompt engineering, context engineering, RAG, and AI Agents.

🤖 Language Models
MDXMITupdated Mar 11, 2026
GitHub ↗★ 80.3K⑂ 8.8K
Search & Retrieval#18

headroomlabs-ai/headroom🔥 active

▲ +610 ★ this week

Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.

PythonApache-2.0updated Nov 20, 2026
GitHub ↗★ 80.2K⑂ 6.3K
OCR & Documents#19

tesseract-ocr/tesseract🔥 active

▲ +100 ★ this week

Tesseract Open Source OCR Engine (main repository)

C++Apache-2.0updated Nov 20, 2026
GitHub ↗★ 77.6K⑂ 10.9K
Language Models#20

hiyouga/LlamaFactory🔥 active

▲ +133 ★ this week

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

🧠 Natural Language Processing
PythonApache-2.0updated Nov 21, 2026
GitHub ↗★ 76.2K⑂ 9.4K
Language Models#21

binary-husky/gpt_academic

▲ +46 ★ this week

为GPT/GLM等LLM大语言模型提供实用化交互接口,特别优化论文阅读/润色/写作体验,模块化设计,支持自定义快捷按钮&函数插件,支持Python和C++等项目剖析&自译解功能,PDF/LaTex论文翻译&总结功能,支持并行问询多种LLM模型,支持chatglm3等本地模型。接入通义千问, deepseekcoder, 讯飞星火, 文心一言, llama2, rwkv, claude2, moss等。

PythonGPL-3.0updated Jan 25, 2026
GitHub ↗★ 71.7K⑂ 8.3K
Natural Language Processing#22

microsoft/AI-For-Beginners🔥 active

▲ +310 ★ this week

12 Weeks, 24 Lessons, AI for All!

Jupyter NotebookMITupdated Nov 15, 2026
GitHub ↗★ 71.1K⑂ 13.8K
OCR & Documents#23

docling-project/docling🔥 active

▲ +273 ★ this week

Get your documents ready for gen AI

PythonMITupdated Nov 21, 2026
GitHub ↗★ 70.8K⑂ 5.4K
Search & Retrieval#24

mem0ai/mem0🔥 active

▲ +350 ★ this week

The Memory Layer for AI Agents - Drop-in memory infrastructure for AI agents and apps. Context that persists. Built for production.

PythonApache-2.0updated Nov 18, 2026
GitHub ↗★ 69.3K⑂ 8.2K

Browse by category

All categories →