Language Models
data-prep-kit/data-prep-kit
▲ +1 ★ this week
Open source project for data preparation for GenAI applications
HTMLApache-2.0updated Sep 29, 2026
Scalable data pre processing and curation toolkit for LLMs
$ git clone https://github.com/NVIDIA-NeMo/Curator.git▲ +1 ★ this week
Open source project for data preparation for GenAI applications
▲ +22 ★ this week
Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷
Toolkit for Machine Learning, Natural Language Processing, and Text Generation, in TensorFlow. This is part of the CASL project: http://casl-project.ai/
▲ +2 ★ this week
Data and tools for generating and inspecting OLMo pre-training data.
▲ +1 ★ this week
Integrating the Best of TF into PyTorch, for Machine Learning, Natural Language Processing, and Text Generation. This is part of the CASL project: http://casl-project.ai/
Data from GitHub · snapshot Nov 16, 2026