Language Models
🏆 #3,330 overall#746 of 1,375 in Language Models
bigscience-workshop /data-preparation
Code used for sourcing and cleaning the BigScience ROOTS corpus
$ git clone https://github.com/bigscience-workshop/data-preparation.gitStars
318
318
This week
—
Forks
41
41
Language
Jupyter Notebook
License
Apache-2.0
Created
Apr 25, 2022
4.6 years old
Last push
Mar 20, 2023
Categories
GitHub topics
More in Language Models
Language Models
OpenMOSS/MOSS-TTSD
▲ +3 ★ this week
A multilingual model for long-form, multi-speaker dialogue synthesis with flexible speaker control and zero-shot voice cloning
PythonApache-2.0updated Sep 6, 2026
Language Models
xinxuxin/keystone-bench
A clinical decision-evidence benchmark: pull the one fact an answer rests on, and see whether the assistant's action moves with the evidence. Built on HealthBench.
PythonOtherupdated Oct 19, 2026
Language Models
wenhaochai/MovieChat
[CVPR 2024] MovieChat: From Dense Token to Sparse Memory for Long Video Understanding
PythonBSD-3-Clauseupdated Jan 29, 2025
Language Models
google-deepmind/long-form-factuality
Benchmarking long-form factuality in large language models. Original code for our paper "Long-form factuality in large language models".
PythonOtherupdated Jun 18, 2026
Language Models
HowieHwong/TrustLLM
[ICML 2024] TrustLLM: LLM trustworthiness evaluation across truthfulness, safety, fairness, robustness, privacy and ethics. Python/CLI toolkit for local models, compatible APIs and AI agent orchestration.
🧠 Natural Language Processing
PythonMITupdated Oct 4, 2026
Data from GitHub · snapshot Nov 13, 2026