rasbt/LLMs-from-scratch๐ฅ active
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
Detailed python notes & code for lectures and exercises of Andrej Karpathy's course "Neural Networks: Zero to Hero." The course is focused on building neural networks from scratch.
$ git clone https://github.com/chizkidd/Karpathy-Neural-Networks-Zero-to-Hero.gitImplement a ChatGPT-like LLM in PyTorch from scratch, step by step
Implementation of the LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens Paper
Full-stack open-source AI engine for building language models โ tokenizer training, transformer architecture, cognitive reasoning and chat pipeline.
This repository contains the collection of explorative notebooks pure in python and in the language that we, humans can read. Have tried to compile all lectures from the Andrej Karpathy's ๐ playlist on Neural Networks - which we will end up with building GPT.
๐ซ Industrial-strength Natural Language Processing (NLP) in Python
Achieve the llama3 inference step-by-step, grasp the core concepts, master the process derivation, implement the code.
Data from GitHub ยท snapshot Sep 24, 2026