Google AI 2018 BERT pytorch implementation
$ git clone https://github.com/codertimo/BERT-pytorch.gitExtremeBERT is a toolkit that accelerates the pretraining of customized language models on customized datasets, described in the paper “ExtremeBERT: A Toolkit for Accelerating Pretraining of Customized BERT”.
Pre-trained Chinese ELECTRA（中文ELECTRA预训练模型）
Korean BERT pre-trained cased (KoBERT)
Transformers4Rec is a flexible and efficient library for sequential and session-based recommendation and works with PyTorch.
Revisiting Pre-trained Models for Chinese Natural Language Processing (MacBERT)
A Lite Bert For Self-Supervised Learning Language Representations
Data from GitHub · snapshot Sep 24, 2026