amd
/

Qwen2.5-1.5B-Instruct-awq-uint4-asym-g128-lmhead-g32-fp16-onnx-hybrid

Text Generation

Model card Files Files and versions Community

Qwen2.5-1.5B-Instruct-awq-uint4-asym-g128-lmhead-g32-fp16-onnx-hybrid / rai_config.json

uday610's picture

Update rai_config.json

604f95a verified about 1 month ago

history blame contribute delete

60 Bytes

	{
	"max_prompt_length": {
	"1.4.1": 3072
	}

	}