Open Source Natural Language Processing

General-purpose natural language processing toolkits: tokenizing, tagging, parsing and modeling text in dozens of languages. Start here if you need a broad NLP library rather than a single-task tool.

2,559
projects
3.6M ★
total stars
+5.6K
stars this week
Python
top language

ranked by GitHub stars · updated Nov 12, 2026

🔥 Trending this week in Natural Language Processing

Natural Language Processing

rasbt/LLMs-from-scratch🔥 active

▲ +441 ★ this week

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

🤖 Language Models✂️ Tokenization & Preprocessing
Jupyter NotebookOtherupdated Nov 9, 2026
GitHub ↗★ 108.3K⑂ 16.7K
Natural Language Processing

NandhaKishorM/laya🔥 active

▲ +403 ★ this week

Non-autoregressive System 1 decision engine. Typed choice, score and yes/no decisions over any text in a single forward pass, in 100+ languages, with a router that picks the right checkpoint per request.

PythonApache-2.0updated Nov 10, 2026
GitHub ↗★ 35.5K⑂ 3.2K
Natural Language Processing

huggingface/transformers🔥 active

▲ +336 ★ this week

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

🎙️ Speech Recognition
PythonApache-2.0updated Nov 12, 2026
GitHub ↗★ 168.9K⑂ 35.2K
Natural Language Processing

nanaism/yomiyasu🔥 active

▲ +296 ★ this week

AI生成の日本語を自然な日本語へ推敲するAgent Skill / Agent Skill for Refining AI-Generated Japanese into Natural Japanese

PythonMITupdated Nov 12, 2026
GitHub ↗★ 3.2K⑂ 82
Natural Language Processing

neuml/txtai🔥 active

▲ +272 ★ this week

💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows

🔍 Search & Retrieval🤖 Language Models🧬 Embeddings
PythonApache-2.0updated Nov 11, 2026
GitHub ↗★ 13.3K⑂ 994
Natural Language Processing

d2l-ai/d2l-zh

▲ +216 ★ this week

《动手学深度学习》:面向中文读者、能运行、可讨论。中英文版被70多个国家的500多所大学用于教学。

PythonApache-2.0updated Jul 30, 2024
GitHub ↗★ 82.5K⑂ 12.5K

Top 30 NLP libraries by stars

Natural Language Processing🥇#1

huggingface/transformers🔥 active

▲ +336 ★ this week

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

🎙️ Speech Recognition
PythonApache-2.0updated Nov 12, 2026
GitHub ↗★ 168.9K⑂ 35.2K
Natural Language Processing🥈#2

rasbt/LLMs-from-scratch🔥 active

▲ +441 ★ this week

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

🤖 Language Models✂️ Tokenization & Preprocessing
Jupyter NotebookOtherupdated Nov 9, 2026
GitHub ↗★ 108.3K⑂ 16.7K
Natural Language Processing🥉#3

d2l-ai/d2l-zh

▲ +216 ★ this week

《动手学深度学习》:面向中文读者、能运行、可讨论。中英文版被70多个国家的500多所大学用于教学。

PythonApache-2.0updated Jul 30, 2024
GitHub ↗★ 82.5K⑂ 12.5K
Natural Language Processing#4

hiyouga/LlamaFactory🔥 active

▲ +118 ★ this week

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

🤖 Language Models
PythonApache-2.0updated Nov 12, 2026
GitHub ↗★ 76K⑂ 9.4K
Natural Language Processing#5

microsoft/AI-For-Beginners

▲ +148 ★ this week

12 Weeks, 24 Lessons, AI for All!

Jupyter NotebookMITupdated Nov 4, 2026
GitHub ↗★ 70.7K⑂ 13.8K
Natural Language Processing#6

GokuMohandas/Made-With-ML

▲ +68 ★ this week

Learn how to develop, deploy and iterate on production-grade ML applications.

Jupyter NotebookMITupdated Mar 4, 2026
GitHub ↗★ 50K⑂ 7.8K
Natural Language Processing#7

666ghj/BettaFish

▲ +78 ★ this week

微舆:人人可用的多Agent舆情分析助手,打破信息茧房,还原舆情原貌,预测未来走向,辅助决策!从0实现,不依赖任何框架。

💖 Sentiment Analysis
PythonGPL-2.0updated Oct 16, 2026
GitHub ↗★ 42.7K⑂ 7.6K
Natural Language Processing#8

apachecn/ailearning

▲ +8 ★ this week

AiLearning:数据分析+机器学习实战+线性代数+PyTorch+NLTK+TF2

PythonOtherupdated Nov 12, 2024
GitHub ↗★ 42.6K⑂ 11.5K
Natural Language Processing#9

google/langextract🔥 active

▲ +31 ★ this week

A Python library for extracting structured information from unstructured text using LLMs with precise source grounding and interactive visualization.

🤖 Language Models
PythonApache-2.0updated Nov 10, 2026
GitHub ↗★ 39.3K⑂ 2.8K
Natural Language Processing#11

hankcs/HanLP🔥 active

▲ +2 ★ this week

中文分词 词性标注 命名实体识别 依存句法分析 成分句法分析 语义依存分析 语义角色标注 指代消解 风格转换 语义相似度 新词发现 关键词短语提取 自动摘要 文本分类聚类 拼音简繁转换 自然语言处理

🏷️ Named Entity Recognition🗂️ Text Classification
PythonApache-2.0updated Nov 7, 2026
GitHub ↗★ 36.5K⑂ 10.9K
Natural Language Processing#12

NandhaKishorM/laya🔥 active

▲ +403 ★ this week

Non-autoregressive System 1 decision engine. Typed choice, score and yes/no decisions over any text in a single forward pass, in 100+ languages, with a router that picks the right checkpoint per request.

PythonApache-2.0updated Nov 10, 2026
GitHub ↗★ 35.5K⑂ 3.2K
Natural Language Processing#13

explosion/spaCy

▲ +21 ★ this week

💫 Industrial-strength Natural Language Processing (NLP) in Python

🏷️ Named Entity Recognition🗂️ Text Classification✂️ Tokenization & Preprocessing
PythonMITupdated Oct 27, 2026
GitHub ↗★ 34K⑂ 4.7K
Natural Language Processing#14

stanford-oval/storm

▲ +75 ★ this week

An LLM-powered knowledge curation system that researches a topic and generates a full-length report with citations.

🔍 Search & Retrieval🤖 Language Models
PythonMITupdated Sep 30, 2025
GitHub ↗★ 31.9K⑂ 3K
Natural Language Processing#15

eugeneyan/applied-ml

▲ +108 ★ this week

📚 Papers & tech blogs by companies sharing their work on data science & machine learning in production.

OtherMITupdated Jul 18, 2024
GitHub ↗★ 30.9K⑂ 4.1K
Natural Language Processing#16

NirDiamant/RAG_Techniques

▲ +91 ★ this week

This repository showcases various advanced techniques for Retrieval-Augmented Generation (RAG) systems. Each technique has a detailed notebook tutorial.

🔍 Search & Retrieval
Jupyter NotebookOtherupdated Nov 2, 2026
GitHub ↗★ 30.3K⑂ 3.7K
Natural Language Processing#17

d2l-ai/d2l-en

▲ +36 ★ this week

Interactive deep learning book with multi-framework code, math, and discussions. Adopted at 500 universities from 70 countries including Stanford, MIT, Harvard, and Cambridge.

PythonOtherupdated Aug 18, 2024
GitHub ↗★ 30K⑂ 5.2K
Natural Language Processing#18

srbhr/Resume-Matcher🔥 active

▲ +122 ★ this week

The #1 AI Harness for Building Resumes, PDFs, Cover Letters & more, locally with 100+ LLMs support.

🧬 Embeddings🔍 Search & Retrieval
PythonApache-2.0updated Nov 11, 2026
GitHub ↗★ 29.3K⑂ 5.1K
Natural Language Processing#19

AccumulateMore/CV

▲ +57 ★ this week

✅(已完结)超级全面的 深度学习 笔记【土堆 Pytorch】【李沐 动手学深度学习】【吴恩达 深度学习】【大飞 大模型Agent】

🔍 Search & Retrieval
Jupyter Notebookno licenseupdated Sep 20, 2026
GitHub ↗★ 24.3K⑂ 2.7K
Natural Language Processing#20

lukasmasuch/best-of-ml-python🔥 active

▲ +10 ★ this week

🏆 A ranked list of awesome machine learning Python libraries. Updated weekly.

OtherCC-BY-SA-4.0updated Nov 12, 2026
GitHub ↗★ 23.9K⑂ 3.1K
Natural Language Processing#21

sebastianruder/NLP-progress

Repository to track the progress in Natural Language Processing (NLP), including the datasets and the current state-of-the-art for the most common NLP tasks.

🏷️ Named Entity Recognition🌍 Machine Translation
PythonMITupdated Jul 28, 2024
GitHub ↗★ 23K⑂ 3.6K
Natural Language Processing#22

microsoft/unilm

▲ +2 ★ this week

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

📄 OCR & Documents
PythonMITupdated Sep 21, 2026
GitHub ↗★ 22.2K⑂ 2.7K
Natural Language Processing#23

huggingface/datasets🔥 active

▲ +13 ★ this week

🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools

PythonApache-2.0updated Nov 12, 2026
GitHub ↗★ 22.1K⑂ 3.6K
Natural Language Processing#24

QwenLM/Qwen

▲ +27 ★ this week

The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.

🤖 Language Models
PythonApache-2.0updated Mar 5, 2026
GitHub ↗★ 22K⑂ 2K
Natural Language Processing#25

bee-san/Ciphey🔥 active

▲ +11 ★ this week

⚡ Automatically decrypt encryptions without knowing the key or cipher, decode encodings, and crack hashes ⚡

RustMITupdated Nov 6, 2026
GitHub ↗★ 21.8K⑂ 1.4K
Natural Language Processing#26

AI4Finance-Foundation/FinGPT

▲ +28 ★ this week

FinGPT: Open-Source Financial Large Language Models! Revolutionize 🔥 We release the trained model on HuggingFace.

💖 Sentiment Analysis🤖 Language Models
Jupyter NotebookMITupdated Oct 25, 2026
GitHub ↗★ 21.6K⑂ 3.1K
Natural Language Processing#27

RasaHQ/rasa

▲ +11 ★ this week

💬 Open source machine learning framework to automate text- and voice-based conversations: NLU, dialogue management, connect to Slack, Facebook, and more - Create chatbots and voice assistants

PythonApache-2.0updated Jul 24, 2026
GitHub ↗★ 21.4K⑂ 4.9K
Natural Language Processing#28

ShusenTang/Dive-into-DL-PyTorch

▲ +1 ★ this week

本项目将《动手学深度学习》(Dive into Deep Learning)原书中的MXNet实现改为PyTorch实现。

Jupyter NotebookApache-2.0updated Oct 14, 2021
GitHub ↗★ 19.5K⑂ 5.4K
Natural Language Processing#29

ymcui/Chinese-LLaMA-Alpaca

中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

🤖 Language Models
PythonApache-2.0updated Apr 19, 2026
GitHub ↗★ 18.9K⑂ 1.8K
Natural Language Processing#30

arc53/DocsGPT🔥 active

▲ +19 ★ this week

Private AI platform for agents, assistants and enterprise search. Built-in Agent Builder, Deep research, Document analysis, Multi-model support, and API connectivity for agents.

🔍 Search & Retrieval🤖 Language Models
PythonMITupdated Nov 12, 2026
GitHub ↗★ 18.4K⑂ 2.3K