🏆 #4,506 overall#1627 of 2,559 in Natural Language Processing

monologg /DistilKoBERT

Distillation of KoBERT from SKTBrain (Lightweight KoBERT)

$ git clone https://github.com/monologg/DistilKoBERT.git
GitHub social preview for monologg/DistilKoBERT
Stars
201
201
This week
—
Forks
23
23
Language
Python
License
Apache-2.0
Created
Nov 23, 2019
7.0 years old
Last push
Sep 6, 2023

Categories

GitHub topics

More in Natural Language Processing

Natural Language Processing

SKTBrain/KoBERT

▲ +1 ★ this week

Korean BERT pre-trained cased (KoBERT)

🤖 Language Models
PythonApache-2.0updated Jun 14, 2025
GitHub ↗★ 1.4K⑂ 374
Natural Language Processing

monologg/KoBigBird

🦅 Pretrained BigBird Model for Korean (up to 4096 tokens)

PythonApache-2.0updated Dec 28, 2023
GitHub ↗★ 201⑂ 21
Natural Language Processing

NielsRogge/Transformers-Tutorials

This repository contains demos I made with the Transformers library by HuggingFace.

Jupyter NotebookMITupdated Sep 17, 2026
GitHub ↗★ 11.8K⑂ 1.7K
Natural Language Processing

jessevig/bertviz

▲ +7 ★ this week

BertViz: Visualize Attention in Transformer Models

PythonApache-2.0updated Jan 8, 2026
GitHub ↗★ 8.2K⑂ 887
Natural Language Processing

adapter-hub/adapters

▲ +1 ★ this week

A Unified Library for Parameter-Efficient and Modular Transfer Learning

PythonApache-2.0updated Apr 26, 2026
GitHub ↗★ 2.8K⑂ 373
Natural Language Processing

airaria/TextBrewer

A PyTorch-based knowledge distillation toolkit for natural language processing

PythonApache-2.0updated May 8, 2023
GitHub ↗★ 1.7K⑂ 242

Data from GitHub · snapshot Nov 13, 2026