xinxuxin/keystone-bench
A clinical decision-evidence benchmark: pull the one fact an answer rests on, and see whether the assistant's action moves with the evidence. Built on HealthBench.
A new multi-shot video understanding benchmark Shot2Story with comprehensive video summaries and detailed shot-level captions.
$ git clone https://github.com/bytedance/Shot2Story.gitA clinical decision-evidence benchmark: pull the one fact an answer rests on, and see whether the assistant's action moves with the evidence. Built on HealthBench.
Benchmarking long-form factuality in large language models. Original code for our paper "Long-form factuality in large language models".
[ICML 2024] TrustLLM: LLM trustworthiness evaluation across truthfulness, safety, fairness, robustness, privacy and ethics. Python/CLI toolkit for local models, compatible APIs and AI agent orchestration.
▲ +15 ★ this week
Dataset and benchmark for RAG on company internal documents.
[ICLR 2025] xFinder: Large Language Models as Automated Evaluators for Reliable Evaluation
▲ +8 ★ this week
One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks
Data from GitHub · snapshot Nov 13, 2026