Tokenization & Preprocessing
glayzzle/php-parser
:herb: NodeJS PHP Parser - extract AST or tokens
JavaScriptBSD-3-Clauseupdated Sep 10, 2026
🏆 #2,386 overall#90 of 148 in Tokenization & Preprocessing
netgen /query-translator
Query Translator is a search query translator with AST representation
$ git clone https://github.com/netgen/query-translator.gitStars
206
206
Forks
11
11
Language
PHP
License
MIT
Created
Mar 23, 2017
9.5 years old
Last push
Feb 13, 2026
Categories
More in Tokenization & Preprocessing
Tokenization & Preprocessing
leodevbro/vscode-blockman
VSCode extension to highlight nested code blocks
TypeScriptMITupdated Jul 17, 2026
Tokenization & Preprocessing
mck89/peast
JavaScript parser written in PHP that generates AST from your code according to ECMAScript specification
PHPBSD-3-Clauseupdated Sep 15, 2026
Tokenization & Preprocessing
theseer/tokenizer
A small library for converting tokenized PHP source code into XML (and potentially other formats)
PHPOtherupdated Feb 3, 2026
Tokenization & Preprocessing
risesoft-y9/Data-Labeling
数据标注是一款专门对文本数据进行处理和标注的工具，通过简化快捷的文本标注流程和动态的算法反馈，支持用户快速标注关键词并能通过算法持续减少人工标注的成本和时间。数据标注的过程先由人工标注构建基础，再由自动标注反哺人工标注，最后由人工标注进行纠偏，从而大幅度提高标注的精准度和高效性。数据标注需要依赖开源的数字底座进行人员岗位管控。
JavaGPL-3.0updated Jun 23, 2025
Tokenization & Preprocessing
tlaceby/guide-to-interpreters-series
Contains source-code for viewers following along with my Beginners Guide To Building Interpreters series on my Youtube Channel.
TypeScriptno licenseupdated May 2, 2024
Data from GitHub · snapshot Sep 24, 2026