Natural Language Processing
brightmart/nlp_chinese_corpus
▲ +2 ★ this week
大规模中文自然语言处理语料 Large Scale Chinese Corpus for NLP
🗂️ Text Classification❓ Question Answering🧬 Embeddings🤖 Language Models
OtherMITupdated Feb 6, 2026
🏆 #3,305 overall#1177 of 2,559 in Natural Language Processing
linonetwo /segmentit
任何 JS 环境可用的中文分词包，fork from leizongmin/node-segment
$ git clone https://github.com/linonetwo/segmentit.gitStars
321
321
This week
—
Forks
16
16
Language
JavaScript
License
MIT
Created
Nov 7, 2017
9.0 years old
Last push
Apr 13, 2023
Categories
GitHub topics
More in Natural Language Processing
Natural Language Processing
esbatmop/MNBVC
▲ +6 ★ this week
MNBVC(Massive Never-ending BT Vast Chinese corpus)超大规模中文语料集。对标chatGPT训练的40T数据。MNBVC数据集不但包括主流文化，也包括各个小众文化甚至火星文的数据。MNBVC数据集包括新闻、作文、小说、书籍、杂志、论文、台词、帖子、wiki、古诗、歌词、商品介绍、笑话、糗事、聊天记录等一切形式的纯文本中文数据。
OtherMITupdated Oct 25, 2026
Natural Language Processing
CVI-SZU/Linly
▲ +1 ★ this week
Chinese-LLaMA 1&2、Chinese-Falcon 基础模型；ChatFlow中文对话模型；中文OpenLLaMA模型；NLP预训练/指令微调数据集
🤖 Language Models
Pythonno licenseupdated Apr 14, 2024
Natural Language Processing
tim5go/zhopenie
Chinese Open Information Extraction (Tree-based Triple Relation Extraction Module)
⛏️ Information Extraction
Pythonno licenseupdated Jun 19, 2017
Natural Language Processing
Morizeyao/GPT2-Chinese
▲ +2 ★ this week
Chinese version of GPT2 training code, using BERT tokenizer.
🤖 Language Models
PythonMITupdated Apr 25, 2024
Natural Language Processing
NLPchina/ansj_seg
▲ +1 ★ this week
ansj分词.ict的真正java实现.分词效果速度都超过开源版的ict. 中文分词,人名识别,词性标注,用户自定义词典
JavaApache-2.0updated Nov 19, 2023
Data from GitHub · snapshot Nov 13, 2026