Language Models
microsoft/LoRA
Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
PythonMITupdated Dec 17, 2024
🏆 #104 overall#36 of 601 in Language Models🔥 active this week
BlinkDL /RWKV-LM
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.
$ git clone https://github.com/BlinkDL/RWKV-LM.gitStars
14.7K
14,718
Forks
1K
1,021
Language
Python
License
Apache-2.0
Created
Aug 8, 2021
5.1 years old
Last push
Sep 21, 2026
🔥 this week
Categories
More in Language Models
Language Models
voidful/TextRL
Implementation of ChatGPT RLHF (Reinforcement Learning with Human Feedback) on any generation model in huggingface's transformer (blommz-176B/bloom/gpt/bart/T5/MetaICL)
🧠 Natural Language Processing
PythonMITupdated Apr 23, 2026
Language Models
rasbt/LLMs-from-scratch🔥 active
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
✂️ Tokenization & Preprocessing🧠 Natural Language Processing
Jupyter NotebookOtherupdated Sep 22, 2026
Language Models
OptimalScale/LMFlow
An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.
PythonApache-2.0updated Aug 10, 2026
Language Models
raiyanyahya/how-to-train-your-gpt
Build a modern LLM from scratch. Every line commented. Explained like we are five.
🧠 Natural Language Processing
Jupyter NotebookMITupdated Aug 30, 2026
Language Models
microsoft/generative-ai-for-beginners🔥 active
21 Lessons, Get Started Building with Generative AI
🔍 Search & Retrieval
Jupyter NotebookMITupdated Sep 24, 2026
Data from GitHub · snapshot Sep 24, 2026