RedHatAI

/

Phi-3-mini-128k-instruct-quantized.w8a8

like 0

Follow

Red Hat AI 1.07k

Model doesnt load in vllm version 0.5.0 : ValueError: `rope_scaling`'s type field must be one of ['su', 'yarn'], got longrope