Tokenization & Preprocessing
Chevrotain/chevrotain๐ฅ active
โฒ +2 โ this week
Parser Building Toolkit for JavaScript
TypeScriptApache-2.0updated Nov 14, 2026
Optimised tokenizer/lexer generator! ๐ Uses /y for performance. Moo.
$ git clone https://github.com/no-context/moo.gitโฒ +2 โ this week
Parser Building Toolkit for JavaScript
โฒ +1 โ this week
NodeJS PHP Parser - extract AST or tokens
Contains source-code for viewers following along with my Beginners Guide To Building Interpreters series on my Youtube Channel.
โฒ +1 โ this week
JS tokenizer for LLaMA 1 and 2
Data from GitHub ยท snapshot Nov 16, 2026