How to use qwen_2.5_vl_7b_ultra-qX_0.gguf in ComfyUI?

by DanyaTrolleybus - opened Aug 13

Aug 13

Is there any way to use these quants in ComfyUI?
I get an error "This text model is incompatible with llama.cpp!" when trying.
I use city96/ComfyUI-GGUF custom node

calcuis

Owner Aug 13

it works with gguf-node (pypi|repo|pack); that's pig quant

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment