Apil-Shrestha/token-efficiency-lex🔥 active
▲ +1 ★ this week
Token Cost Parity: Multilingual LLM Efficiency Analysis 2026
Code for Zero-Shot Tokenizer Transfer
$ git clone https://github.com/bminixhofer/zett.git▲ +1 ★ this week
Token Cost Parity: Multilingual LLM Efficiency Analysis 2026
▲ +1 ★ this week
Easy token price estimates for 400+ LLMs. TokenOps.
▲ +1 ★ this week
Trankit is a Light-Weight Transformer-based Python Toolkit for Multilingual Natural Language Processing
Achieve the llama3 inference step-by-step, grasp the core concepts, master the process derivation, implement the code.
▲ +21 ★ this week
Cevahir Zihin: a mind that learns by living, not a Transformer. It keeps knowledge as evidence on ties, attends with a Seven-Place Focus and learns from every conversation. Also: a Turkish BPE tokenizer, a Transformer language-model core and cognitive systems.
Implementation of the LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens Paper
Data from GitHub · snapshot Nov 16, 2026