Natural Language Processing
catherinesyeh/attention-viz
Visualizing query-key interactions in language + vision transformers (VIS 2023)
HTMLMITupdated May 5, 2024
Worth-reading papers and related resources on attention mechanism, Transformer and pretrained language model (PLM) such as BERT. 值得一读的注意力机制、Transformer和预训练语言模型论文与相关资源集合
$ git clone https://github.com/ZhengZixiang/ATPapers.gitVisualizing query-key interactions in language + vision transformers (VIS 2023)
BERT4ETH: A Pre-trained Transformer for Ethereum Fraud Detection (WWW23)
Natural Language Processing Tutorial for Deep Learning Researchers
▲ +7 ★ this week
BertViz: Visualize Attention in Transformer Models
▲ +1 ★ this week
Google AI 2018 BERT pytorch implementation
Transformer related optimization, including BERT, GPT
Data from GitHub · snapshot Nov 13, 2026