license: apache-2.0
datasets:
- Code2Logic/GameQA-140K
- Code2Logic/GameQA-5K
base_model:
- llava-hf/llava-onevision-qwen2-7b-ov-hf
This model (GameQA-LLaVA-OV-7B) results from training LLaVA-OV-7B with GRPO solely on our GameQA-5K (sampled from the full GameQA-140K dataset).
Evaluation Results on General Vision BenchMarks
(The inference and evaluation configurations were unified across both the original open-source models and our trained models.)
Code2Logic: Game-Code-Driven Data Synthesis for Enhancing VLMs General Reasoning
This is the first work, to the best of our knowledge, that leverages game code to synthesize multimodal reasoning data for training VLMs. Furthermore, when trained with a GRPO strategy solely on GameQA (synthesized via our proposed Code2Logic approach), multiple cutting-edge open-source models exhibit significantly enhanced out-of-domain generalization.
[📖 Paper] [🤗 GameQA-140K Dataset] [🤗 GameQA-5K Dataset] [🤗 GameQA-InternVL3-8B ] [🤗 GameQA-Qwen2.5-VL-7B] [🤗 GameQA-LLaVA-OV-7B ]
News
- We've open-sourced the three models trained with GRPO on GameQA on Huggingface.