amd
/

Qwen2.5-1.5B-Instruct-awq-uint4-asym-g128-lmhead-g32-fp16-onnx-hybrid

Text Generation

Model card Files Files and versions

Qwen2.5-1.5B-Instruct-awq-uint4-asym-g128-lmhead-g32-fp16-onnx-hybrid / rai_config.json

satreysa's picture

Update rai_config.json

7bd9168 verified 6 months ago

history blame contribute delete

83 Bytes

	{
	"max_prompt_length": {
	"1.4.1": 3072,
	"1.5.0": 3072
	}

	}