Language Models
NVIDIA-NeMo/Curator🔥 active
Scalable data pre processing and curation toolkit for LLMs
PythonApache-2.0updated Sep 23, 2026
🏆 #1,058 overall#305 of 601 in Language Models
data-prep-kit /data-prep-kit
Open source project for data preparation for GenAI applications
$ git clone https://github.com/data-prep-kit/data-prep-kit.gitStars
964
964
Forks
256
256
Language
HTML
License
Apache-2.0
Created
Apr 8, 2024
2.5 years old
Last push
Sep 8, 2026
Categories
More in Language Models
Language Models
rasbt/LLMs-from-scratch🔥 active
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
✂️ Tokenization & Preprocessing🧠 Natural Language Processing
Jupyter NotebookOtherupdated Sep 22, 2026
Language Models
datajuicer/data-juicer🔥 active
Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷
PythonApache-2.0updated Sep 22, 2026
Language Models
Language Models
stochasticai/xTuring
Build, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6
PythonApache-2.0updated Sep 12, 2026
Language Models
adithya-s-k/AI-Engineering.academy
Mastering Applied AI, One Concept at a Time
Jupyter NotebookMITupdated Feb 27, 2026
Data from GitHub · snapshot Sep 24, 2026