Language Models
data-prep-kit/data-prep-kit
Open source project for data preparation for GenAI applications
HTMLApache-2.0updated Sep 8, 2026
🏆 #698 overall#207 of 601 in Language Models🔥 active this week
NVIDIA-NeMo /Curator
Scalable data pre processing and curation toolkit for LLMs
$ git clone https://github.com/NVIDIA-NeMo/Curator.gitStars
1.8K
1,781
Forks
333
333
Language
Python
License
Apache-2.0
Created
Mar 14, 2024
2.5 years old
Last push
Sep 23, 2026
🔥 this week
Categories
More in Language Models
Language Models
datajuicer/data-juicer🔥 active
Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷
PythonApache-2.0updated Sep 22, 2026
Language Models
Language Models
allenai/dolma
Data and tools for generating and inspecting OLMo pre-training data.
🧠 Natural Language Processing
PythonApache-2.0updated Aug 24, 2026
Language Models
langflow-ai/langflow🔥 active
Langflow is a powerful tool for building and deploying AI-powered agents and workflows.
PythonMITupdated Sep 24, 2026
Language Models
microsoft/generative-ai-for-beginners🔥 active
21 Lessons, Get Started Building with Generative AI
🔍 Search & Retrieval
Jupyter NotebookMITupdated Sep 24, 2026
Data from GitHub · snapshot Sep 24, 2026