๐Ÿ† #2,988 overall#65 of 178 in Tokenization & Preprocessing

SaberaTalukder /TOTEM

The official code ๐Ÿ‘ฉโ€๐Ÿ’ป for - TOTEM: TOkenized Time Series EMbeddings for General Time Series Analysis

$ git clone https://github.com/SaberaTalukder/TOTEM.git
GitHub social preview for SaberaTalukder/TOTEM
Stars
374
374
This week
+1 โ˜…
+1 this month
Forks
64
64
Language
Python
License
None
Created
Feb 27, 2024
2.7 years old
Last push
Feb 20, 2025

Stars, last 30 days

Oct 15, 2026 โ†’ Nov 16, 2026
โ˜… 373โ–ฒ +1โ˜… 374

Categories

GitHub topics

More in Tokenization & Preprocessing

Tokenization & Preprocessing

toon-format/toon๐Ÿ”ฅ active

โ–ฒ +15 โ˜… this week

๐ŸŽ’ Token-Oriented Object Notation (TOON) โ€“ compact, human-readable serialization of JSON data for LLM prompts. TypeScript SDK, CLI, benchmarks.

TypeScriptMITupdated Nov 11, 2026
GitHub โ†—โ˜… 25.6Kโ‘‚ 1.1K
Tokenization & Preprocessing

marcelroed/gigatoken

โ–ฒ +2 โ˜… this week

Language model tokenization at GB/s

๐Ÿง  Natural Language Processing
RustMITupdated Nov 2, 2026
GitHub โ†—โ˜… 4.2Kโ‘‚ 225
Tokenization & Preprocessing

AgentOps-AI/tokencost

โ–ฒ +1 โ˜… this week

Easy token price estimates for 400+ LLMs. TokenOps.

๐Ÿค– Language Models
PythonMITupdated Sep 5, 2025
GitHub โ†—โ˜… 2Kโ‘‚ 109
Tokenization & Preprocessing

RavenProject/Ravencoin

โ–ฒ +1 โ˜… this week

Ravencoin Core integration/staging tree

CMITupdated Aug 18, 2026
GitHub โ†—โ˜… 1.1Kโ‘‚ 727
Tokenization & Preprocessing

cbaziotis/ekphrasis

โ–ฒ +1 โ˜… this week

Ekphrasis is a text processing tool, geared towards text from social networks, such as Twitter or Facebook. Ekphrasis performs tokenization, word normalization, word segmentation (for splitting hashtags) and spell correction, using word statistics from 2 big corpora (english Wikipedia, twitter - 330mil english tweets).

๐Ÿง  Natural Language Processing๐Ÿ’Ž Text Mining
PythonMITupdated Jun 2, 2025
GitHub โ†—โ˜… 672โ‘‚ 91
Tokenization & Preprocessing

alasdairforsythe/tokenmonster

โ–ฒ +3 โ˜… this week

Ungreedy subword tokenizer and vocabulary trainer for Python, Go, C++ & Javascript

GoMITupdated Jul 10, 2026
GitHub โ†—โ˜… 627โ‘‚ 23

Data from GitHub ยท snapshot Nov 16, 2026