🏆 #283 overall#71 of 1,378 in Language Models

EleutherAI /gpt-neox

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries

$ git clone https://github.com/EleutherAI/gpt-neox.git
GitHub social preview for EleutherAI/gpt-neox
Stars
7.5K
7,476
This week
+4 ★
+5 this month
Forks
1.1K
1,131
Language
Python
License
Apache-2.0
Created
Dec 22, 2020
5.9 years old
Last push
Nov 7, 2026

Stars, last 30 days

Oct 15, 2026 → Nov 16, 2026
★ 7.5K▲ +5★ 7.5K

Categories

GitHub topics

More in Language Models

Language Models

BlinkDL/RWKV-LM

▲ +5 ★ this week

RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.

PythonApache-2.0updated Nov 4, 2026
GitHub ↗★ 14.8K⑂ 1K
Language Models

microsoft/LoRA

▲ +16 ★ this week

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

PythonMITupdated Dec 17, 2024
GitHub ↗★ 13.9K⑂ 936
Language Models

huggingface/tokenizers🔥 active

▲ +21 ★ this week

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

🧠 Natural Language Processing
RustApache-2.0updated Nov 16, 2026
GitHub ↗★ 11.2K⑂ 1.3K
Language Models

CVI-SZU/Linly

▲ +1 ★ this week

Chinese-LLaMA 1&2、Chinese-Falcon 基础模型;ChatFlow中文对话模型;中文OpenLLaMA模型;NLP预训练/指令微调数据集

🧠 Natural Language Processing
Pythonno licenseupdated Apr 14, 2024
GitHub ↗★ 3K⑂ 221

Data from GitHub · snapshot Nov 16, 2026