Language Models
michiyasunaga/LinkBERT
▲ +1 ★ this week
[ACL 2022] LinkBERT: A Knowledgeable Language Model 😎 Pretrained with Document Links
❓ Question Answering
PythonApache-2.0updated Apr 5, 2022
Code for "Reasoning to Learn from Latent Thoughts"
$ git clone https://github.com/ryoungj/BoLT.git▲ +1 ★ this week
[ACL 2022] LinkBERT: A Knowledgeable Language Model 😎 Pretrained with Document Links
[NeurIPS 2022] DRAGON 🐲: Deep Bidirectional Language-Knowledge Graph Pretraining
Transformer with Untied Positional Encoding (TUPE). Code of paper "Rethinking Positional Encoding in Language Pre-training". Improve existing models like BERT.
▲ +4 ★ this week
Official codebase for "Next-Latent Prediction Transformers Learn Compact World Models"
Soft-MTP: Multi-Token Prediction Done Right. KL gradient recovery for faster speculative decoding and better language model training.
▲ +393 ★ this week
21 Lessons, Get Started Building with Generative AI
Data from GitHub · snapshot Nov 13, 2026