Tokenization & Preprocessing
rasbt/LLMs-from-scratch🔥 active
▲ +435 ★ this week
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
🤖 Language Models🧠 Natural Language Processing
Jupyter NotebookOtherupdated Nov 9, 2026
🏆 #5,153 overall#124 of 178 in Tokenization & Preprocessing🔥 active this week
riponcm /GemType
Free, open-source Grammarly alternative for Chrome & Safari — AI grammar checker and text rewriter for any website, powered by your own free Google Gemini API key. No account, no tracking, no subscription.
$ git clone https://github.com/riponcm/GemType.gitStars
163
163
This week
—
Forks
10
10
Language
JavaScript
License
Apache-2.0
Created
Jul 3, 2026
0.4 years old
Last push
Nov 12, 2026
🔥 this week
Categories
More in Tokenization & Preprocessing
Tokenization & Preprocessing
explosion/spaCy
▲ +18 ★ this week
💫 Industrial-strength Natural Language Processing (NLP) in Python
🧠 Natural Language Processing🏷️ Named Entity Recognition🗂️ Text Classification
PythonMITupdated Oct 27, 2026
Tokenization & Preprocessing
Chevrotain/chevrotain🔥 active
▲ +1 ★ this week
Parser Building Toolkit for JavaScript
TypeScriptApache-2.0updated Nov 12, 2026
Tokenization & Preprocessing
sylvainhalle/textidote
Spelling, grammar and style checking on LaTeX documents
JavaGPL-3.0updated Sep 9, 2026
Tokenization & Preprocessing
no-context/moo
▲ +2 ★ this week
Optimised tokenizer/lexer generator! 🐄 Uses /y for performance. Moo.
JavaScriptBSD-3-Clauseupdated Feb 27, 2026
Tokenization & Preprocessing
glayzzle/php-parser
▲ +1 ★ this week
NodeJS PHP Parser - extract AST or tokens
JavaScriptBSD-3-Clauseupdated Oct 30, 2026
Data from GitHub · snapshot Nov 13, 2026