🏆 #5,953 overall#2171 of 2,559 in Natural Language Processing

ZhengZixiang /ATPapers

Worth-reading papers and related resources on attention mechanism, Transformer and pretrained language model (PLM) such as BERT. 值得一读的注意力机制、Transformer和预训练语言模型论文与相关资源集合

$ git clone https://github.com/ZhengZixiang/ATPapers.git
GitHub social preview for ZhengZixiang/ATPapers
Stars
129
129
This week
—
Forks
13
13
Language
Other
License
None
Created
Nov 2, 2019
7.0 years old
Last push
Mar 27, 2021

Categories

GitHub topics

More in Natural Language Processing

Natural Language Processing

catherinesyeh/attention-viz

Visualizing query-key interactions in language + vision transformers (VIS 2023)

HTMLMITupdated May 5, 2024
GitHub ↗★ 172⑂ 22
Natural Language Processing

git-disl/BERT4ETH

BERT4ETH: A Pre-trained Transformer for Ethereum Fraud Detection (WWW23)

Pythonno licenseupdated Jun 21, 2024
GitHub ↗★ 121⑂ 21
Natural Language Processing

graykode/nlp-tutorial

Natural Language Processing Tutorial for Deep Learning Researchers

Jupyter NotebookMITupdated Feb 21, 2024
GitHub ↗★ 14.9K⑂ 3.9K
Natural Language Processing

jessevig/bertviz

▲ +7 ★ this week

BertViz: Visualize Attention in Transformer Models

PythonApache-2.0updated Jan 8, 2026
GitHub ↗★ 8.2K⑂ 887
Natural Language Processing

codertimo/BERT-pytorch

▲ +1 ★ this week

Google AI 2018 BERT pytorch implementation

🤖 Language Models
PythonApache-2.0updated Sep 15, 2023
GitHub ↗★ 6.5K⑂ 1.3K

Data from GitHub · snapshot Nov 13, 2026