Indonesian Language Models and its Usage
$ git clone https://github.com/cahya-wirawan/indonesian-language-models.gitExtremeBERT is a toolkit that accelerates the pretraining of customized language models on customized datasets, described in the paper “ExtremeBERT: A Toolkit for Accelerating Pretraining of Customized BERT”.
▲ +1 ★ this week
Research code for pixel-based encoders of language (PIXEL)
This is the corresponding code for the book Transformers in Action
PyTorch Language Model for 1-Billion Word (LM1B / GBW) Dataset
GAP-text2SQL: Learning Contextual Representations for Semantic Parsing with Generation-Augmented Pre-Training
▲ +1 ★ this week
Google AI 2018 BERT pytorch implementation
Data from GitHub · snapshot Nov 13, 2026