This repository contains the collection of explorative notebooks pure in python and in the language that we, humans can read. Have tried to compile all lectures from the Andrej Karpathy's 💎 playlist on Neural Networks - which we will end up with building GPT.
$ git clone https://github.com/AayushSameerShah/Neural-Net-Zero-to-Hero-with-Andrej.gitDetailed python notes & code for lectures and exercises of Andrej Karpathy's course "Neural Networks: Zero to Hero." The course is focused on building neural networks from scratch.
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
💫 Industrial-strength Natural Language Processing (NLP) in Python
Build a ChatGPT like LLM from scratch in PyTorch, explained step by step.
[CVPR 2026 Highlight] A Frame is Worth One Token: Efficient Generative World Modeling with Delta Tokens
Implementation of the LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens Paper
Data from GitHub · snapshot Sep 24, 2026