Language Models
FoundationVision/Groma
[ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization
PythonApache-2.0updated Jun 7, 2024
Embed arbitrary modalities (images, audio, documents, etc) into large language models.
$ git clone https://github.com/sshh12/multi_token.git[ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization
LLaVA-Mini is a unified large multimodal model (LMM) that can support the understanding of images, high-resolution images, and videos in an efficient manner.
From scratch implementation of a vision language model in pure PyTorch
[NeurIPS 2024] This repo contains evaluation code for the paper "Are We on the Right Way for Evaluating Large Vision-Language Models"
Align Anything: Training All-modality Model with Feedback
▲ +8 ★ this week
One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks
Data from GitHub · snapshot Nov 13, 2026