🏆 #3,005 overall#1071 of 2,559 in Natural Language Processing

ymcui /PERT

PERT: Pre-training BERT with Permuted Language Model

$ git clone https://github.com/ymcui/PERT.git
GitHub social preview for ymcui/PERT
Stars
369
369
This week
—
Forks
25
25
Language
Other
License
Apache-2.0
Created
Jan 4, 2022
4.9 years old
Last push
Apr 19, 2026

Categories

GitHub topics

More in Natural Language Processing

Natural Language Processing

ymcui/Chinese-ELECTRA

Pre-trained Chinese ELECTRA(中文ELECTRA预训练模型)

🤖 Language Models
PythonApache-2.0updated Apr 19, 2026
GitHub ↗★ 1.4K⑂ 166
Natural Language Processing

ymcui/MacBERT

▲ +1 ★ this week

Revisiting Pre-trained Models for Chinese Natural Language Processing (MacBERT)

🤖 Language Models
OtherApache-2.0updated Apr 19, 2026
GitHub ↗★ 728⑂ 61
Natural Language Processing

ymcui/LERT

LERT: A Linguistically-motivated Pre-trained Language Model(语言学信息增强的预训练模型LERT)

PythonApache-2.0updated Apr 19, 2026
GitHub ↗★ 228⑂ 15
Natural Language Processing

graykode/nlp-tutorial

Natural Language Processing Tutorial for Deep Learning Researchers

Jupyter NotebookMITupdated Feb 21, 2024
GitHub ↗★ 14.9K⑂ 3.9K
Natural Language Processing

ymcui/Chinese-BERT-wwm

▲ +1 ★ this week

Pre-Training with Whole Word Masking for Chinese BERT(中文BERT-wwm系列模型)

PythonApache-2.0updated Apr 19, 2026
GitHub ↗★ 10.2K⑂ 1.4K
Natural Language Processing

jessevig/bertviz

▲ +7 ★ this week

BertViz: Visualize Attention in Transformer Models

PythonApache-2.0updated Jan 8, 2026
GitHub ↗★ 8.2K⑂ 887

Data from GitHub · snapshot Nov 13, 2026