🏆 #3,024 overall#68 of 178 in Tokenization & Preprocessing

macmade /ClangKit

ClangKit provides an Objective-C frontend to LibClang. Source tokenization, diagnostics and fix-its are actually implemented.

$ git clone https://github.com/macmade/ClangKit.git
GitHub social preview for macmade/ClangKit
Stars
367
367
This week
+1 ★
+1 this month
Forks
45
45
Language
C
License
None
Created
Aug 12, 2012
14.3 years old
Last push
Aug 2, 2021

Stars, last 30 days

Oct 15, 2026 → Nov 16, 2026
★ 366▲ +1★ 367

Categories

GitHub topics

More in Tokenization & Preprocessing

Tokenization & Preprocessing

Chevrotain/chevrotain🔥 active

▲ +2 ★ this week

Parser Building Toolkit for JavaScript

TypeScriptApache-2.0updated Nov 14, 2026
GitHub ↗★ 2.8K⑂ 222
Tokenization & Preprocessing

lionsoul2014/friso

▲ +1 ★ this week

High performance Chinese tokenizer with both GBK and UTF-8 charset support based on MMSEG algorithm developed by ANSI C. Completely based on modular implementation and can be easily embedded in other programs, like: MySQL, PostgreSQL, PHP, etc.

CApache-2.0updated Oct 29, 2023
GitHub ↗★ 515⑂ 93
Tokenization & Preprocessing

mck89/peast

JavaScript parser written in PHP that generates AST from your code according to ECMAScript specification

PHPBSD-3-Clauseupdated Sep 29, 2026
GitHub ↗★ 194⑂ 28
Tokenization & Preprocessing

untitaker/html5gum

▲ +1 ★ this week

A WHATWG-compliant HTML5 tokenizer and tag soup parser

RustMITupdated Nov 9, 2026
GitHub ↗★ 175⑂ 18
Tokenization & Preprocessing

GlitchedPolygons/l8w8jwt

Minimal, OpenSSL-less and super lightweight JWT library written in C.

CApache-2.0updated Aug 16, 2025
GitHub ↗★ 174⑂ 50
Tokenization & Preprocessing

actual-computer/toks

exact tokenizers ids, as fast as the hardware allows

CApache-2.0updated Nov 5, 2026
GitHub ↗★ 118⑂ 10

Data from GitHub · snapshot Nov 16, 2026