Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
$ git clone https://github.com/microsoft/LoRA.gitRWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.
Implementation of ChatGPT RLHF (Reinforcement Learning with Human Feedback) on any generation model in huggingface's transformer (blommz-176B/bloom/gpt/bart/T5/MetaICL)
A PyTorch-based Speech Toolkit
An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.
Open Source Neural Machine Translation and (Large) Language Models in PyTorch
Data from GitHub · snapshot Sep 24, 2026