The official evaluation suite and dynamic data release for MixEval.
$ git clone https://github.com/JinjieNi/MixEval.git▲ +1 ★ this week
This repo contains evaluation code for the paper "MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI"
▲ +8 ★ this week
One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks
▲ +1 ★ this week
An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.
The official GitHub page for the survey paper "A Survey on Evaluation of Large Language Models".
A clinical decision-evidence benchmark: pull the one fact an answer rests on, and see whether the assistant's action moves with the evidence. Built on HealthBench.
[EMNLP 2024 & AAAI 2026] A powerful toolkit for compressing large models including LLMs, VLMs, and video generative models.
Data from GitHub · snapshot Nov 13, 2026