🏆 #4,934 overall#1791 of 2,559 in Natural Language Processing

pmichel31415 /are-16-heads-really-better-than-1

Code for the paper "Are Sixteen Heads Really Better than One?"

$ git clone https://github.com/pmichel31415/are-16-heads-really-better-than-1.git
GitHub social preview for pmichel31415/are-16-heads-really-better-than-1
Stars
175
175
This week
—
Forks
15
15
Language
Shell
License
MIT
Created
May 24, 2019
7.5 years old
Last push
Apr 1, 2020

Categories

GitHub topics

More in Natural Language Processing

Natural Language Processing

jessevig/bertviz

▲ +7 ★ this week

BertViz: Visualize Attention in Transformer Models

PythonApache-2.0updated Jan 8, 2026
GitHub ↗★ 8.2K⑂ 887
Natural Language Processing

extreme-bert/extreme-bert

ExtremeBERT is a toolkit that accelerates the pretraining of customized language models on customized datasets, described in the paper “ExtremeBERT: A Toolkit for Accelerating Pretraining of Customized BERT”.

🤖 Language Models
PythonApache-2.0updated Mar 5, 2023
GitHub ↗★ 268⑂ 14
Natural Language Processing

graykode/nlp-tutorial

Natural Language Processing Tutorial for Deep Learning Researchers

Jupyter NotebookMITupdated Feb 21, 2024
GitHub ↗★ 14.9K⑂ 3.9K
Natural Language Processing

MaartenGr/BERTopic

▲ +20 ★ this week

Leveraging BERT and c-TF-IDF to create easily interpretable topics.

🫧 Topic Modeling🧬 Embeddings
PythonMITupdated Nov 5, 2026
GitHub ↗★ 8K⑂ 932
Natural Language Processing

codertimo/BERT-pytorch

▲ +1 ★ this week

Google AI 2018 BERT pytorch implementation

🤖 Language Models
PythonApache-2.0updated Sep 15, 2023
GitHub ↗★ 6.5K⑂ 1.3K
Natural Language Processing

thunlp/PromptPapers

Must-read papers on prompt-based tuning for pre-trained language models.

Otherno licenseupdated Jul 17, 2023
GitHub ↗★ 4.3K⑂ 388

Data from GitHub · snapshot Nov 13, 2026