Natural Language Processing
jessevig/bertviz
▲ +7 ★ this week
BertViz: Visualize Attention in Transformer Models
PythonApache-2.0updated Jan 8, 2026
Code for the paper "Are Sixteen Heads Really Better than One?"
$ git clone https://github.com/pmichel31415/are-16-heads-really-better-than-1.git▲ +7 ★ this week
BertViz: Visualize Attention in Transformer Models
ExtremeBERT is a toolkit that accelerates the pretraining of customized language models on customized datasets, described in the paper “ExtremeBERT: A Toolkit for Accelerating Pretraining of Customized BERT”.
Natural Language Processing Tutorial for Deep Learning Researchers
▲ +20 ★ this week
Leveraging BERT and c-TF-IDF to create easily interpretable topics.
▲ +1 ★ this week
Google AI 2018 BERT pytorch implementation
Must-read papers on prompt-based tuning for pre-trained language models.
Data from GitHub · snapshot Nov 13, 2026