🏆 #918 overall#216 of 1,378 in Language Models🔥 active this week

NVIDIA-NeMo /Curator

Scalable data pre processing and curation toolkit for LLMs

$ git clone https://github.com/NVIDIA-NeMo/Curator.git
GitHub social preview for NVIDIA-NeMo/Curator
Stars
1.9K
1,861
This week
+5 ★
Forks
378
378
Language
Python
License
Apache-2.0
Created
Mar 14, 2024
2.7 years old
Last push
Nov 16, 2026
🔥 this week

Stars, last 17 days

Oct 28, 2026 → Nov 16, 2026
★ 1.8K▲ +31★ 1.9K

Categories

GitHub topics

More in Language Models

Language Models

data-prep-kit/data-prep-kit

▲ +1 ★ this week

Open source project for data preparation for GenAI applications

HTMLApache-2.0updated Sep 29, 2026
GitHub ↗★ 969⑂ 257
Language Models

datajuicer/data-juicer🔥 active

▲ +22 ★ this week

Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷

PythonApache-2.0updated Nov 16, 2026
GitHub ↗★ 7.3K⑂ 455
Language Models

asyml/texar

Toolkit for Machine Learning, Natural Language Processing, and Text Generation, in TensorFlow. This is part of the CASL project: http://casl-project.ai/

🧠 Natural Language Processing🌍 Machine Translation
PythonApache-2.0updated Jul 21, 2026
GitHub ↗★ 2.4K⑂ 367
Language Models

allenai/dolma

▲ +2 ★ this week

Data and tools for generating and inspecting OLMo pre-training data.

🧠 Natural Language Processing
PythonApache-2.0updated Aug 24, 2026
GitHub ↗★ 1.6K⑂ 207
Language Models

asyml/texar-pytorch

▲ +1 ★ this week

Integrating the Best of TF into PyTorch, for Machine Learning, Natural Language Processing, and Text Generation. This is part of the CASL project: http://casl-project.ai/

🧠 Natural Language Processing🌍 Machine Translation
PythonApache-2.0updated Apr 14, 2022
GitHub ↗★ 746⑂ 111

Data from GitHub · snapshot Nov 16, 2026