🏆 #1,105 overall#17 of 178 in Tokenization & Preprocessing

lunasec-io /lunasec

LunaSec - Dependency Security Scanner that automatically notifies you about vulnerabilities like Log4Shell or node-ipc in your Pull Requests and Builds. Protect yourself in 30 seconds with the LunaTrace GitHub App: https://github.com/marketplace/lunatrace-by-lunasec/

$ git clone https://github.com/lunasec-io/lunasec.git
GitHub social preview for lunasec-io/lunasec
Stars
1.5K
1,474
This week
+1 ★
+2 this month
Forks
165
165
Language
TypeScript
License
Other
Created
Mar 16, 2021
5.7 years old
Last push
May 2, 2024

Stars, last 30 days

Oct 15, 2026 → Nov 16, 2026
★ 1.5K▲ +2★ 1.5K

Categories

GitHub topics

More in Tokenization & Preprocessing

Tokenization & Preprocessing

securitybunker/databunker🔥 active

▲ +2 ★ this week

Secure Vault for Customer PII/PHI/PCI/KYC Records

GoMITupdated Nov 13, 2026
GitHub ↗★ 1.5K⑂ 102
Tokenization & Preprocessing

rasbt/LLMs-from-scratch

▲ +499 ★ this week

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

🤖 Language Models🧠 Natural Language Processing
Jupyter NotebookOtherupdated Nov 9, 2026
GitHub ↗★ 108.5K⑂ 16.8K
Tokenization & Preprocessing

explosion/spaCy

▲ +24 ★ this week

💫 Industrial-strength Natural Language Processing (NLP) in Python

🧠 Natural Language Processing🏷️ Named Entity Recognition🗂️ Text Classification
PythonMITupdated Oct 27, 2026
GitHub ↗★ 34.1K⑂ 4.7K
Tokenization & Preprocessing

toon-format/toon🔥 active

▲ +15 ★ this week

🎒 Token-Oriented Object Notation (TOON) – compact, human-readable serialization of JSON data for LLM prompts. TypeScript SDK, CLI, benchmarks.

TypeScriptMITupdated Nov 11, 2026
GitHub ↗★ 25.6K⑂ 1.1K
Tokenization & Preprocessing

adbar/trafilatura🔥 active

▲ +43 ★ this week

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

🔍 Search & Retrieval🧠 Natural Language Processing💎 Text Mining
PythonApache-2.0updated Nov 16, 2026
GitHub ↗★ 7.1K⑂ 510
Tokenization & Preprocessing

theseer/tokenizer

▲ +2 ★ this week

A small library for converting tokenized PHP source code into XML (and potentially other formats)

PHPOtherupdated Feb 3, 2026
GitHub ↗★ 5.2K⑂ 25

Data from GitHub · snapshot Nov 16, 2026