🏆 #4,494 overall#1621 of 2,559 in Natural Language Processing

intersun /PKD-for-BERT-Model-Compression

pytorch implementation for Patient Knowledge Distillation for BERT Model Compression

$ git clone https://github.com/intersun/PKD-for-BERT-Model-Compression.git
GitHub social preview for intersun/PKD-for-BERT-Model-Compression
Stars
202
202
This week
—
Forks
44
44
Language
Python
License
None
Created
Aug 25, 2019
7.2 years old
Last push
Sep 20, 2019

Categories

GitHub topics

More in Natural Language Processing

Natural Language Processing

graykode/nlp-tutorial

Natural Language Processing Tutorial for Deep Learning Researchers

Jupyter NotebookMITupdated Feb 21, 2024
GitHub ↗★ 14.9K⑂ 3.9K
Natural Language Processing

NielsRogge/Transformers-Tutorials

This repository contains demos I made with the Transformers library by HuggingFace.

Jupyter NotebookMITupdated Sep 17, 2026
GitHub ↗★ 11.8K⑂ 1.7K
Natural Language Processing

ymcui/Chinese-BERT-wwm

▲ +1 ★ this week

Pre-Training with Whole Word Masking for Chinese BERT(中文BERT-wwm系列模型)

PythonApache-2.0updated Apr 19, 2026
GitHub ↗★ 10.2K⑂ 1.4K
Natural Language Processing

jessevig/bertviz

▲ +7 ★ this week

BertViz: Visualize Attention in Transformer Models

PythonApache-2.0updated Jan 8, 2026
GitHub ↗★ 8.2K⑂ 887
Natural Language Processing

codertimo/BERT-pytorch

▲ +1 ★ this week

Google AI 2018 BERT pytorch implementation

🤖 Language Models
PythonApache-2.0updated Sep 15, 2023
GitHub ↗★ 6.5K⑂ 1.3K

Data from GitHub · snapshot Nov 13, 2026