Natural Language Processing
ymcui/Chinese-ELECTRA
Pre-trained Chinese ELECTRA(中文ELECTRA预训练模型)
🤖 Language Models
PythonApache-2.0updated Apr 19, 2026
PERT: Pre-training BERT with Permuted Language Model
$ git clone https://github.com/ymcui/PERT.gitPre-trained Chinese ELECTRA(中文ELECTRA预训练模型)
▲ +1 ★ this week
Revisiting Pre-trained Models for Chinese Natural Language Processing (MacBERT)
LERT: A Linguistically-motivated Pre-trained Language Model(语言学信息增强的预训练模型LERT)
Natural Language Processing Tutorial for Deep Learning Researchers
▲ +1 ★ this week
Pre-Training with Whole Word Masking for Chinese BERT(中文BERT-wwm系列模型)
▲ +7 ★ this week
BertViz: Visualize Attention in Transformer Models
Data from GitHub · snapshot Nov 13, 2026