Language Models
codertimo/BERT-pytorch
▲ +1 ★ this week
Google AI 2018 BERT pytorch implementation
🧠 Natural Language Processing
PythonApache-2.0updated Sep 15, 2023
Transformer with Untied Positional Encoding (TUPE). Code of paper "Rethinking Positional Encoding in Language Pre-training". Improve existing models like BERT.
$ git clone https://github.com/guolinke/TUPE.git▲ +1 ★ this week
Google AI 2018 BERT pytorch implementation
NLP Paper
ExtremeBERT is a toolkit that accelerates the pretraining of customized language models on customized datasets, described in the paper “ExtremeBERT: A Toolkit for Accelerating Pretraining of Customized BERT”.
Arabic edition of BERT pretrained language models
▲ +1 ★ this week
[ACL 2022] LinkBERT: A Knowledgeable Language Model 😎 Pretrained with Document Links
[NeurIPS 2022] DRAGON 🐲: Deep Bidirectional Language-Knowledge Graph Pretraining
Data from GitHub · snapshot Nov 16, 2026