Tokenization & Preprocessing
🏆 #2,051 overall#41 of 178 in Tokenization & Preprocessing🔥 active this week
jflex-de /jflex
The fast scanner generator for Java™ with full Unicode support
$ git clone https://github.com/jflex-de/jflex.gitStars
637
637
This week
+1 ★
+3 this month
Forks
119
119
Language
Java
License
Other
Created
Feb 15, 2015
11.8 years old
Last push
Nov 16, 2026
🔥 this week
Stars, last 30 days
Oct 15, 2026 → Nov 16, 2026Categories
More in Tokenization & Preprocessing
Tokenization & Preprocessing
Chevrotain/chevrotain🔥 active
▲ +2 ★ this week
Parser Building Toolkit for JavaScript
TypeScriptApache-2.0updated Nov 14, 2026
Tokenization & Preprocessing
no-context/moo
▲ +2 ★ this week
Optimised tokenizer/lexer generator! 🐄 Uses /y for performance. Moo.
JavaScriptBSD-3-Clauseupdated Feb 27, 2026
Tokenization & Preprocessing
risesoft-y9/Data-Labeling
▲ +1 ★ this week
数据标注是一款专门对文本数据进行处理和标注的工具,通过简化快捷的文本标注流程和动态的算法反馈,支持用户快速标注关键词并能通过算法持续减少人工标注的成本和时间。数据标注的过程先由人工标注构建基础,再由自动标注反哺人工标注,最后由人工标注进行纠偏,从而大幅度提高标注的精准度和高效性。数据标注需要依赖开源的数字底座进行人员岗位管控。
JavaGPL-3.0updated Jun 23, 2025
Tokenization & Preprocessing
glayzzle/php-parser
▲ +1 ★ this week
NodeJS PHP Parser - extract AST or tokens
JavaScriptBSD-3-Clauseupdated Oct 30, 2026
Tokenization & Preprocessing
Data from GitHub · snapshot Nov 16, 2026