🏆 #3,760 overall#91 of 178 in Tokenization & Preprocessing

OpenMOSS /MOSS-Audio-Tokenizer

A 1.6B causal Transformer audio tokenizer with streaming, variable bitrates, and semantic alignment across speech, sound, and music

$ git clone https://github.com/OpenMOSS/MOSS-Audio-Tokenizer.git
GitHub social preview for OpenMOSS/MOSS-Audio-Tokenizer
Stars
268
268
This week
+4 ★
+9 this month
Forks
20
20
Language
Python
License
Apache-2.0
Created
Feb 3, 2026
0.8 years old
Last push
Jun 16, 2026

Stars, last 30 days

Oct 15, 2026 → Nov 16, 2026
★ 259▲ +9★ 268

Categories

GitHub topics

More in Tokenization & Preprocessing

Tokenization & Preprocessing

zhenye234/xcodec🔥 active

AAAI 2025: Codec Does Matter: Exploring the Semantic Shortcoming of Codec for Audio Language Model

🤖 Language Models
PythonMITupdated Nov 10, 2026
GitHub ↗★ 316⑂ 24
Tokenization & Preprocessing

Voine/Bert-VITS2-MNN

A practical on-device BertVITS2 runtime for Android, powered by alibaba-MNN engine. 面向移动端离线语音合成的轻量化 BertVITS2 工程实现,基于阿里 MNN 推理框架。

🧠 Natural Language Processing
C++Apache-2.0updated Aug 5, 2026
GitHub ↗★ 163⑂ 21
Tokenization & Preprocessing

frothywater/kanade-tokenizer

Kanade is a single-layer disentangled speech tokenizer that extracts compact tokens suitable for both generative and discriminative modeling.

Pythonno licenseupdated Jul 18, 2026
GitHub ↗★ 119⑂ 16
Tokenization & Preprocessing

theseer/tokenizer

▲ +2 ★ this week

A small library for converting tokenized PHP source code into XML (and potentially other formats)

PHPOtherupdated Feb 3, 2026
GitHub ↗★ 5.2K⑂ 25
Tokenization & Preprocessing

marcelroed/gigatoken

▲ +2 ★ this week

Language model tokenization at GB/s

🧠 Natural Language Processing
RustMITupdated Nov 2, 2026
GitHub ↗★ 4.2K⑂ 225
Tokenization & Preprocessing

andialbrecht/sqlparse

A non-validating SQL parser module for Python

PythonBSD-3-Clauseupdated Nov 1, 2026
GitHub ↗★ 4K⑂ 781

Data from GitHub · snapshot Nov 16, 2026