🏆 #4,154 overall#1494 of 2,559 in Natural Language Processing

ymcui /LERT

LERT: A Linguistically-motivated Pre-trained Language Model（语言学信息增强的预训练模型LERT）

★ View on GitHub ↗🌐 Homepage ↗

$ git clone https://github.com/ymcui/LERT.git

GitHub social preview for ymcui/LERT

Stars

228

228

This week

—

Forks

15

15

Language

Python

License

Apache-2.0

Created

Jul 21, 2022

4.3 years old

Last push

Apr 19, 2026

Categories

🧠 Natural Language Processing

GitHub topics

#bert #lert #nlp #plm #pre-train #pytorch #tensorflow #transformer

More in Natural Language Processing

Natural Language Processing

graykode/nlp-tutorial

Natural Language Processing Tutorial for Deep Learning Researchers

Jupyter NotebookMITupdated Feb 21, 2024

GitHub ↗★ 14.9K⑂ 3.9K

Natural Language Processing

ymcui/PERT

PERT: Pre-training BERT with Permuted Language Model

OtherApache-2.0updated Apr 19, 2026

GitHub ↗★ 369⑂ 25

Natural Language Processing

ymcui/Chinese-BERT-wwm

▲ +1 ★ this week

Pre-Training with Whole Word Masking for Chinese BERT（中文BERT-wwm系列模型）

PythonApache-2.0updated Apr 19, 2026

GitHub ↗★ 10.2K⑂ 1.4K

Natural Language Processing

jessevig/bertviz

▲ +7 ★ this week

BertViz: Visualize Attention in Transformer Models

PythonApache-2.0updated Jan 8, 2026

GitHub ↗★ 8.2K⑂ 887

Natural Language Processing

codertimo/BERT-pytorch

▲ +1 ★ this week

Google AI 2018 BERT pytorch implementation

🤖 Language Models

PythonApache-2.0updated Sep 15, 2023

GitHub ↗★ 6.5K⑂ 1.3K

Natural Language Processing

ymcui/Chinese-ELECTRA

Pre-trained Chinese ELECTRA（中文ELECTRA预训练模型）

🤖 Language Models

PythonApache-2.0updated Apr 19, 2026

GitHub ↗★ 1.4K⑂ 166

See all 2,559 in Natural Language Processing →

Data from GitHub · snapshot Nov 13, 2026