rasbt/LLMs-from-scratchπ₯ active
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
Official Code for "Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agents"
$ git clone https://github.com/huangwl18/language-planner.gitImplement a ChatGPT-like LLM in PyTorch from scratch, step by step
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.
Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
γε€§θ―θ¨ζ¨‘εγδ½θ οΌθ΅΅ι«οΌζεζ― οΌε¨ζοΌε倩δΈοΌζη»§θ£
An open-source framework for training large multimodal models.
Self-contained Machine Learning and Natural Language Processing library in Go
Data from GitHub Β· snapshot Sep 24, 2026