Tokenization & Preprocessing
🏆 #2,201 overall#79 of 148 in Tokenization & Preprocessing🔥 active this week
Kronova-Intelligent-Systems /asset-intel-orchestration-engine
Open-source platform for multi-agent AI orchestration, real-world asset tokenization, workflow automation. Includes OAuth 2.1 MCP agent management, a 44-field RWA schema, Stripe, designed to integrate with AetherNet QUAS & KVS sovereign, post quantum, architecture agnostic omni-substrate, semantic memory, & institutional settlement system.
$ git clone https://github.com/Kronova-Intelligent-Systems/asset-intel-orchestration-engine.gitStars
251
251
Forks
37
37
Language
TypeScript
License
Other
Created
Jan 28, 2024
2.7 years old
Last push
Sep 22, 2026
🔥 this week
Categories
More in Tokenization & Preprocessing
Tokenization & Preprocessing
snchimata/tokenfold🔥 active
Private, provider-neutral context compression for LLMs. Reversibly compress schemas and logs inside your perimeter with zero third-party calls.
RustApache-2.0updated Sep 21, 2026
Tokenization & Preprocessing
rasbt/LLMs-from-scratch🔥 active
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
🤖 Language Models🧠 Natural Language Processing
Jupyter NotebookOtherupdated Sep 22, 2026
Tokenization & Preprocessing
explosion/spaCy
💫 Industrial-strength Natural Language Processing (NLP) in Python
🏷️ Named Entity Recognition🗂️ Text Classification🧠 Natural Language Processing
PythonMITupdated Aug 24, 2026
Tokenization & Preprocessing
toon-format/toon
🎒 Token-Oriented Object Notation (TOON) – compact, human-readable serialization of JSON data for LLM prompts. TypeScript SDK, CLI, benchmarks.
TypeScriptMITupdated Sep 3, 2026
Tokenization & Preprocessing
adbar/trafilatura🔥 active
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
🧠 Natural Language Processing💎 Text Mining
PythonApache-2.0updated Sep 21, 2026
Data from GitHub · snapshot Sep 24, 2026