JMMMU

JMMMU's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Articles

AtsuMiyai 

authored a paper 26 days ago

WebChoreArena: Evaluating Web Browsing Agents on Realistic Tedious Web Tasks

Paper • 2506.01952 • Published 26 days ago • 10

AtsuMiyai 

authored a paper 27 days ago

A Benchmark and Evaluation for Real-World Out-of-Distribution Detection Using Vision-Language Models

Paper • 2501.18463 • Published Jan 30 • 1

ku21fan 

updated a dataset 29 days ago

JMMMU/JMMMU

Viewer • Updated 29 days ago • 1.32k • 707 • 16

AtsuMiyai 

authored a paper about 1 month ago

MangaVQA and MangaLMM: A Benchmark and Specialized Model for Multimodal Manga Understanding

Paper • 2505.20298 • Published May 26 • 6

yuexiang96 

authored a paper 3 months ago

ScholarCopilot: Training Large Language Models for Academic Writing with Accurate Citations

Paper • 2504.00824 • Published Apr 1 • 43

AtsuMiyai 

in JMMMU/JMMMU 4 months ago

Typo in validation_Agriculture_1

2

#3 opened 5 months ago by

d-sato

AtsuMiyai 

updated a Space 4 months ago

Running

15

15

JMMMU Leaderboard

🥇

Evaluating LMMs on Japanese subjects

yuexiang96 

authored 3 papers 5 months ago

Demystifying Long Chain-of-Thought Reasoning in LLMs

Paper • 2502.03373 • Published Feb 5 • 59

Critique Fine-Tuning: Learning to Critique is More Effective than Learning to Imitate

Paper • 2501.17703 • Published Jan 29 • 59

Video-MMMU: Evaluating Knowledge Acquisition from Multi-Discipline Professional Videos

Paper • 2501.13826 • Published Jan 23 • 26

yuexiang96 

authored 6 papers 7 months ago

JMMMU: A Japanese Massive Multi-discipline Multimodal Understanding Benchmark for Culture-aware Evaluation

Paper • 2410.17250 • Published Oct 22, 2024 • 15

Long Context Alignment with Short Instructions and Synthesized Positions

Paper • 2405.03939 • Published May 7, 2024

LIME: Less Is More for MLLM Evaluation

Paper • 2409.06851 • Published Sep 10, 2024

Machine Unlearning of Pre-trained Large Language Models

Paper • 2402.15159 • Published Feb 23, 2024

MAmmoTH-VL: Eliciting Multimodal Reasoning with Instruction Tuning at Scale

Paper • 2412.05237 • Published Dec 6, 2024 • 48

Evaluating Language Models as Synthetic Data Generators

Paper • 2412.03679 • Published Dec 4, 2024 • 49

yuexiang96 

authored a paper 8 months ago

Teach Multimodal LLMs to Comprehend Electrocardiographic Images

Paper • 2410.19008 • Published Oct 21, 2024 • 24

yuki-imajuku 

authored a paper 8 months ago

JMMMU: A Japanese Massive Multi-discipline Multimodal Understanding Benchmark for Culture-aware Evaluation

Paper • 2410.17250 • Published Oct 22, 2024 • 15

yuki-imajuku 

updated a dataset 8 months ago

JMMMU/JMMMU

Viewer • Updated 29 days ago • 1.32k • 707 • 16

ku21fan 

authored a paper 8 months ago

JMMMU: A Japanese Massive Multi-discipline Multimodal Understanding Benchmark for Culture-aware Evaluation

Paper • 2410.17250 • Published Oct 22, 2024 • 15