Tokenization & Preprocessing
Chevrotain/chevrotain🔥 active
Parser Building Toolkit for JavaScript
TypeScriptApache-2.0updated Sep 24, 2026
🏆 #2,072 overall#72 of 148 in Tokenization & Preprocessing
tlaceby /guide-to-interpreters-series
Contains source-code for viewers following along with my Beginners Guide To Building Interpreters series on my Youtube Channel.
$ git clone https://github.com/tlaceby/guide-to-interpreters-series.gitStars
286
286
Forks
37
37
Language
TypeScript
License
None
Created
Oct 24, 2022
3.9 years old
Last push
May 2, 2024
Categories
More in Tokenization & Preprocessing
Tokenization & Preprocessing
glayzzle/php-parser
:herb: NodeJS PHP Parser - extract AST or tokens
JavaScriptBSD-3-Clauseupdated Sep 10, 2026
Tokenization & Preprocessing
no-context/moo
Optimised tokenizer/lexer generator! 🐄 Uses /y for performance. Moo.
JavaScriptBSD-3-Clauseupdated Feb 27, 2026
Tokenization & Preprocessing
botisan-ai/gpt3-tokenizer
Isomorphic JavaScript/TypeScript Tokenizer for GPT-3 and Codex Models by OpenAI.
TypeScriptMITupdated Jan 27, 2023
Tokenization & Preprocessing
Tokenization & Preprocessing
leodevbro/vscode-blockman
VSCode extension to highlight nested code blocks
TypeScriptMITupdated Jul 17, 2026
Data from GitHub · snapshot Sep 24, 2026