microsoft/LoRA
▲ +16 ★ this week
Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.
$ git clone https://github.com/BlinkDL/RWKV-LM.git▲ +16 ★ this week
Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
▲ +2 ★ this week
Implementation of ChatGPT RLHF (Reinforcement Learning with Human Feedback) on any generation model in huggingface's transformer (blommz-176B/bloom/gpt/bart/T5/MetaICL)
▲ +499 ★ this week
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.
▲ +6 ★ this week
Build a modern LLM from scratch. Every line commented. Explained like we are five.
A curated collection of interesting applications, repos, and tutorials using large language models (LLM) like GPT-3
Data from GitHub · snapshot Nov 16, 2026