Tokenization & Preprocessing
mck89/peast
JavaScript parser written in PHP that generates AST from your code according to ECMAScript specification
PHPBSD-3-Clauseupdated Sep 29, 2026
Tiny JavaScript tokenizer.
$ git clone https://github.com/lydell/js-tokens.gitJavaScript parser written in PHP that generates AST from your code according to ECMAScript specification
▲ +2 ★ this week
Parser Building Toolkit for JavaScript
▲ +2 ★ this week
Optimised tokenizer/lexer generator! 🐄 Uses /y for performance. Moo.
▲ +1 ★ this week
NodeJS PHP Parser - extract AST or tokens
▲ +1 ★ this week
JS tokenizer for LLaMA 1 and 2
Contains source-code for viewers following along with my Beginners Guide To Building Interpreters series on my Youtube Channel.
Data from GitHub · snapshot Nov 16, 2026