🏆 #1,471 overall#328 of 1,378 in Language Models

data-prep-kit /data-prep-kit

Open source project for data preparation for GenAI applications

$ git clone https://github.com/data-prep-kit/data-prep-kit.git
GitHub social preview for data-prep-kit/data-prep-kit
Stars
969
969
This week
+1 ★
Forks
257
257
Language
HTML
License
Apache-2.0
Created
Apr 8, 2024
2.6 years old
Last push
Sep 29, 2026

Stars, last 17 days

Oct 28, 2026 → Nov 16, 2026
★ 968▲ +1★ 969

Categories

GitHub topics

More in Language Models

Language Models

NVIDIA-NeMo/Curator🔥 active

▲ +5 ★ this week

Scalable data pre processing and curation toolkit for LLMs

PythonApache-2.0updated Nov 16, 2026
GitHub ↗★ 1.9K⑂ 378
Language Models

rasbt/LLMs-from-scratch

▲ +499 ★ this week

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

✂️ Tokenization & Preprocessing🧠 Natural Language Processing
Jupyter NotebookOtherupdated Nov 9, 2026
GitHub ↗★ 108.5K⑂ 16.8K
Language Models

datajuicer/data-juicer🔥 active

▲ +22 ★ this week

Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷

PythonApache-2.0updated Nov 16, 2026
GitHub ↗★ 7.3K⑂ 455
Language Models

stochasticai/xTuring

▲ +3 ★ this week

Build, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6

PythonApache-2.0updated Nov 5, 2026
GitHub ↗★ 2.7K⑂ 209

Data from GitHub · snapshot Nov 16, 2026