๐Ÿ† #3,059 overall#142 of 148 in Tokenization & Preprocessing

explosion /spacy-experimental

๐Ÿงช Cutting-edge experimental spaCy components and features

$ git clone https://github.com/explosion/spacy-experimental.git
GitHub social preview for explosion/spacy-experimental
Stars
104
104
Forks
19
19
Language
Python
License
MIT
Created
Nov 18, 2021
4.8 years old
Last push
Apr 23, 2024

Categories

GitHub topics

More in Tokenization & Preprocessing

Tokenization & Preprocessing

explosion/spacy-streamlit

๐Ÿ‘‘ spaCy building blocks and visualizers for Streamlit apps

๐Ÿท๏ธ Named Entity Recognition๐Ÿ—‚๏ธ Text Classification๐Ÿง  Natural Language Processing
PythonMITupdated Jul 29, 2024
GitHub โ†—โ˜… 863โ‘‚ 113
Tokenization & Preprocessing

taishi-i/nagisa๐Ÿ”ฅ active

A Japanese tokenizer based on recurrent neural networks

๐Ÿง  Natural Language Processing
PythonMITupdated Sep 22, 2026
GitHub โ†—โ˜… 420โ‘‚ 23
Tokenization & Preprocessing

clipperhouse/jargon

Tokenizers and lemmatizers for Go

๐Ÿง  Natural Language Processing
GoMITupdated Sep 2, 2025
GitHub โ†—โ˜… 120โ‘‚ 4
Tokenization & Preprocessing

explosion/spaCy

๐Ÿ’ซ Industrial-strength Natural Language Processing (NLP) in Python

๐Ÿท๏ธ Named Entity Recognition๐Ÿ—‚๏ธ Text Classification๐Ÿง  Natural Language Processing
PythonMITupdated Aug 24, 2026
GitHub โ†—โ˜… 33.9Kโ‘‚ 4.7K
Tokenization & Preprocessing

marcelroed/gigatoken

Language model tokenization at GB/s

๐Ÿง  Natural Language Processing
RustMITupdated Sep 2, 2026
GitHub โ†—โ˜… 4.1Kโ‘‚ 220
Tokenization & Preprocessing

jbesomi/texthero

Text preprocessing, representation and visualization from zero to hero.

๐Ÿงฌ Embeddings๐Ÿง  Natural Language Processing๐Ÿ’Ž Text Mining
PythonMITupdated Aug 29, 2023
GitHub โ†—โ˜… 2.9Kโ‘‚ 236

Data from GitHub ยท snapshot Sep 24, 2026