Product-VQ codebook weights (NVFP4-CB / FP8-CB) served by stock vLLM on Blackwell tensor cores. Spec + plugin: github.com/RobTand/gridbook
Rob
rdtand
AI & ML interests
None yet
Recent Activity
new activity about 14 hours ago
rdtand/Qwen3.8-27B-PrismaAQUA-5.5bit-vllm:tried it myself... liked a model 1 day ago
rdtand/Qwen3.8-27B-PrismaAQUA-5.5bit-vllm updated a model 1 day ago
rdtand/Qwen3.8-27B-PrismaAQUA-5.5bit-vllmOrganizations
None yet
models 19
rdtand/Qwen3.8-27B-PrismaAQUA-5.5bit-vllm
Image-Text-to-Text • 19B • Updated • 353 • 18
rdtand/Hy3-295B-A21B-prismaquant-gridbook-2.9bit-vllm
Text Generation • 104B • Updated • 126 • 3
rdtand/Laguna-S-2.1-prismaquant-gridbook-6bit-vllm
Text Generation • 85B • Updated • 649 • 6
rdtand/Qwen3.6-27B-prismaquant-gridbook-5.5bit-vllm
Image-Text-to-Text • 20B • Updated • 2.42k • 5
rdtand/Gemma4-31B-IT-PrismaQuant-5.5bit-vllm
Text Generation • 19B • Updated • 397 • 1
rdtand/Gemma4-31B-IT-PrismaQuant-6bit-vllm
Text Generation • 22B • Updated • 611 • 1
rdtand/Hy3-295B-A21B-PrismaQuant-5.3bit-2xSpark-vllm
194B • Updated • 1.05k • 1
rdtand/Hy3-295B-A21B-PrismaQuant-2.8bit-gguf-vllm
295B • Updated • 5.65k • 2
rdtand/Ornith-1.0-35B-PrismaAURA-4.75bit-vllm-MTP
Text Generation • 22B • Updated • 3.37k • 7
rdtand/Qwen3.6-27B-PrismaAURA-5.5bit-vllm
20B • Updated • 51.6k • 29
datasets 0
None public yet