Natural Language Processing
brightmart/nlp_chinese_corpus
大规模中文自然语言处理语料 Large Scale Chinese Corpus for NLP
🗂️ Text Classification❓ Question Answering🧬 Embeddings🤖 Language Models
OtherMITupdated Feb 6, 2026
ansj分词.ict的真正java实现.分词效果速度都超过开源版的ict. 中文分词,人名识别,词性标注,用户自定义词典
$ git clone https://github.com/NLPchina/ansj_seg.git大规模中文自然语言处理语料 Large Scale Chinese Corpus for NLP
Chinese version of GPT2 training code, using BERT tokenizer.
👮♂️The sensitive word tool for java.(敏感词/违禁词/违法词/脏词。基于 DFA 算法实现的高性能 java 敏感词过滤工具框架。内置支持单词标签分类分级。请勿发布涉及政治、广告、营销、翻墙、违反国家法律法规等内容。高性能敏感词检测过滤组件,附带繁体简体互换,支持全角半角互换,汉字转拼音,模糊搜索等功能。)
Chinese version of CLIP which achieves Chinese cross-modal retrieval and representation generation.
Repo for BenCao [original name: HuaTuo (华驼)], Instruction-tuning Large Language Models with Chinese Medical Knowledge. 本草(原名:华驼)模型仓库,基于中文医学知识的大语言模型指令微调
搜索所有中文NLP数据集,附常用英文NLP数据集
Data from GitHub · snapshot Sep 24, 2026