🏆 #471 overall#145 of 2,559 in Natural Language Processing

esbatmop /MNBVC

MNBVC(Massive Never-ending BT Vast Chinese corpus)超大规模中文语料集。对标chatGPT训练的40T数据。MNBVC数据集不但包括主流文化,也包括各个小众文化甚至火星文的数据。MNBVC数据集包括新闻、作文、小说、书籍、杂志、论文、台词、帖子、wiki、古诗、歌词、商品介绍、笑话、糗事、聊天记录等一切形式的纯文本中文数据。

$ git clone https://github.com/esbatmop/MNBVC.git
GitHub social preview for esbatmop/MNBVC
Stars
4.3K
4,307
This week
+9 ★
+20 this month
Forks
299
299
Language
Other
License
MIT
Created
Dec 31, 2022
3.9 years old
Last push
Oct 25, 2026

Stars, last 30 days

Oct 15, 2026 → Nov 16, 2026
★ 4.3K▲ +23★ 4.3K

Categories

GitHub topics

More in Natural Language Processing

Natural Language Processing

guhhhhaa/4675-scifi

chinese NLP corpus of chinese science fiction,chinese science fiction corpus : About 4675 Chinese science fiction novels 大约有4675本科幻小说,中文科幻小说自然语言处理语料库,中文科幻小说文本语料库,中文科幻小说文本数据库,科幻小说语料

Otherno licenseupdated Oct 22, 2022
GitHub ↗★ 487⑂ 81
Natural Language Processing

guhhhhaa/wula-scifi

chinese NLP corpus of chinese science fiction, chinese science fiction corpus: Archive of the Ark Plan of Ula Science Fiction Website 乌拉科幻小说网方舟计划存档,中文科幻小说自然语言处理语料库,中文科幻小说文本语料库,中文科幻小说文本数据库,科幻小说语料

Otherno licenseupdated Oct 22, 2022
GitHub ↗★ 141⑂ 35
Natural Language Processing

brightmart/nlp_chinese_corpus

▲ +2 ★ this week

大规模中文自然语言处理语料 Large Scale Chinese Corpus for NLP

🗂️ Text Classification❓ Question Answering🧬 Embeddings🤖 Language Models
OtherMITupdated Feb 6, 2026
GitHub ↗★ 9.9K⑂ 1.5K
Natural Language Processing

CVI-SZU/Linly

▲ +1 ★ this week

Chinese-LLaMA 1&2、Chinese-Falcon 基础模型;ChatFlow中文对话模型;中文OpenLLaMA模型;NLP预训练/指令微调数据集

🤖 Language Models
Pythonno licenseupdated Apr 14, 2024
GitHub ↗★ 3K⑂ 221
Natural Language Processing

linonetwo/segmentit

任何 JS 环境可用的中文分词包,fork from leizongmin/node-segment

JavaScriptMITupdated Apr 13, 2023
GitHub ↗★ 321⑂ 16

Data from GitHub · snapshot Nov 16, 2026