Tokenization & Preprocessing
Chevrotain/chevrotain🔥 active
Parser Building Toolkit for JavaScript
TypeScriptApache-2.0updated Sep 24, 2026
🏆 #3,058 overall#141 of 148 in Tokenization & Preprocessing
JuliaLang /Tokenize.jl
Tokenization for Julia source code
$ git clone https://github.com/JuliaLang/Tokenize.jl.gitStars
104
104
Forks
28
28
Language
Julia
License
Other
Created
Jul 31, 2016
10.1 years old
Last push
Apr 23, 2024
Categories
GitHub topics
More in Tokenization & Preprocessing
Tokenization & Preprocessing
no-context/moo
Optimised tokenizer/lexer generator! 🐄 Uses /y for performance. Moo.
JavaScriptBSD-3-Clauseupdated Feb 27, 2026
Tokenization & Preprocessing
glayzzle/php-parser
:herb: NodeJS PHP Parser - extract AST or tokens
JavaScriptBSD-3-Clauseupdated Sep 10, 2026
Tokenization & Preprocessing
Tokenization & Preprocessing
tlaceby/guide-to-interpreters-series
Contains source-code for viewers following along with my Beginners Guide To Building Interpreters series on my Youtube Channel.
TypeScriptno licenseupdated May 2, 2024
Tokenization & Preprocessing
Data from GitHub · snapshot Sep 24, 2026