🏆 #4,721 overall#1003 of 1,375 in Language Models

sshh12 /multi_token

Embed arbitrary modalities (images, audio, documents, etc) into large language models.

$ git clone https://github.com/sshh12/multi_token.git
GitHub social preview for sshh12/multi_token
Stars
187
187
This week
—
Forks
17
17
Language
Python
License
Apache-2.0
Created
Oct 11, 2023
3.1 years old
Last push
Mar 27, 2024

Categories

GitHub topics

More in Language Models

Language Models

FoundationVision/Groma

[ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization

PythonApache-2.0updated Jun 7, 2024
GitHub ↗★ 587⑂ 44
Language Models

ictnlp/LLaVA-Mini

LLaVA-Mini is a unified large multimodal model (LMM) that can support the understanding of images, high-resolution images, and videos in an efficient manner.

PythonApache-2.0updated Jun 29, 2025
GitHub ↗★ 573⑂ 34
Language Models

AviSoori1x/seemore

From scratch implementation of a vision language model in pure PyTorch

Jupyter NotebookMITupdated May 6, 2024
GitHub ↗★ 262⑂ 31
Language Models

MMStar-Benchmark/MMStar

[NeurIPS 2024] This repo contains evaluation code for the paper "Are We on the Right Way for Evaluating Large Vision-Language Models"

Pythonno licenseupdated Sep 26, 2024
GitHub ↗★ 218⑂ 5
Language Models

EvolvingLMMs-Lab/lmms-eval🔥 active

▲ +8 ★ this week

One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks

PythonOtherupdated Nov 13, 2026
GitHub ↗★ 4.5K⑂ 694

Data from GitHub · snapshot Nov 13, 2026