EvolvingLMMs-Lab/lmms-eval🔥 active
One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks
A clinical decision-evidence benchmark: pull the one fact an answer rests on, and see whether the assistant's action moves with the evidence. Built on HealthBench.
$ git clone https://github.com/xinxuxin/keystone-bench.gitOne-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks
Dataset and benchmark for RAG on company internal documents.
🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.
🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓
The official GitHub page for the survey paper "A Survey on Evaluation of Large Language Models".
Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks
Data from GitHub · snapshot Nov 9, 2026