license: apache-2.0 base_model: - Qwen/Qwen2.5-VL-32B-Instruct
Run with:
vllm serve leon-se/Qwen2.5-VL-32B-Instruct-FP8-Dynamic