Tokenization & Preprocessing
rasbt/LLMs-from-scratch
▲ +499 ★ this week
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
🤖 Language Models🧠 Natural Language Processing
Jupyter NotebookOtherupdated Nov 9, 2026
Build a ChatGPT like LLM from scratch in PyTorch, explained step by step.
$ git clone https://github.com/analyticalrohit/llms-from-scratch.git▲ +499 ★ this week
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
Implementation of the LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens Paper
▲ +24 ★ this week
💫 Industrial-strength Natural Language Processing (NLP) in Python
Implementation of MambaByte in "MambaByte: Token-free Selective State Space Model" in Pytorch and Zeta
The Libre Multilingual Analyzer, a Natural Language Processing (NLP) C++ toolkit.
▲ +1 ★ this week
Trankit is a Light-Weight Transformer-based Python Toolkit for Multilingual Natural Language Processing
Data from GitHub · snapshot Nov 16, 2026