rasbt/LLMs-from-scratch
▲ +499 ★ this week
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
Detailed python notes & code for lectures and exercises of Andrej Karpathy's course "Neural Networks: Zero to Hero." The course is focused on building neural networks from scratch.
$ git clone https://github.com/chizkidd/Karpathy-Neural-Networks-Zero-to-Hero.git▲ +499 ★ this week
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
Implementation of the LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens Paper
▲ +21 ★ this week
Cevahir Zihin: a mind that learns by living, not a Transformer. It keeps knowledge as evidence on ties, attends with a Seven-Place Focus and learns from every conversation. Also: a Turkish BPE tokenizer, a Transformer language-model core and cognitive systems.
▲ +1 ★ this week
This repository contains the collection of explorative notebooks pure in python and in the language that we, humans can read. Have tried to compile all lectures from the Andrej Karpathy's 💎 playlist on Neural Networks - which we will end up with building GPT.
▲ +24 ★ this week
💫 Industrial-strength Natural Language Processing (NLP) in Python
Achieve the llama3 inference step-by-step, grasp the core concepts, master the process derivation, implement the code.
Data from GitHub · snapshot Nov 16, 2026