🏆 #440 overall#104 of 1,378 in Language Models🔥 active this week

EvolvingLMMs-Lab /lmms-eval

One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks

$ git clone https://github.com/EvolvingLMMs-Lab/lmms-eval.git
GitHub social preview for EvolvingLMMs-Lab/lmms-eval
Stars
4.5K
4,497
This week
+7 ★
Forks
698
698
Language
Python
License
Other
Created
Mar 7, 2024
2.7 years old
Last push
Nov 15, 2026
🔥 this week

Stars, last 17 days

Oct 28, 2026 → Nov 16, 2026
★ 4.5K▲ +29★ 4.5K

Categories

GitHub topics

More in Language Models

Language Models

xinxuxin/keystone-bench

A clinical decision-evidence benchmark: pull the one fact an answer rests on, and see whether the assistant's action moves with the evidence. Built on HealthBench.

PythonOtherupdated Oct 19, 2026
GitHub ↗★ 1.1K⑂ 3
Language Models

HowieHwong/TrustLLM

[ICML 2024] TrustLLM: LLM trustworthiness evaluation across truthfulness, safety, fairness, robustness, privacy and ethics. Python/CLI toolkit for local models, compatible APIs and AI agent orchestration.

🧠 Natural Language Processing
PythonMITupdated Oct 4, 2026
GitHub ↗★ 636⑂ 69
Language Models

langfuse/langfuse🔥 active

▲ +350 ★ this week

🪢 Open source AI engineering platform: AI Gateway, agent observability, evals, and prompt/skill management, built on OpenTelemetry. One open platform for every AI call and every agent. Self-host or use Langfuse Cloud.

TypeScriptOtherupdated Nov 16, 2026
GitHub ↗★ 37.5K⑂ 4.2K
Language Models

Helicone/helicone🔥 active

▲ +10 ★ this week

🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓

TypeScriptApache-2.0updated Nov 12, 2026
GitHub ↗★ 6.3K⑂ 705
Language Models

MLGroupJLU/LLM-eval-survey

▲ +1 ★ this week

The official GitHub page for the survey paper "A Survey on Evaluation of Large Language Models".

Otherno licenseupdated Nov 9, 2026
GitHub ↗★ 1.6K⑂ 107

Data from GitHub · snapshot Nov 16, 2026