Nick Durkee
ndurkee
AI & ML interests
None yet
Organizations
None yet
vllm docs
2
#1 opened 3 months ago
by
ndurkee
Reasoning setting examples
➕
6
1
#10 opened 4 months ago
by
ndurkee
GPTQ/AWQ
👀
14
4
#3 opened 7 months ago
by
ndurkee
FP8 weights
4
#41 opened 8 months ago
by
chriswritescode
Any chance your team is working on a 4-bit Llama-3.2-90B-Vision-Instruct-quantized.w4a16 version?
2
#1 opened about 1 year ago
by
mrhendrey
🚩 Report
2
#7 opened about 1 year ago
by
nisten
quantization gptq_marlin (not found gptq_marlin) not work. , remove it. work.
8
#7 opened over 1 year ago
by
linpan
Update chat template to resemble the prompt as stated in the model card.
👍
15
7
#176 opened over 1 year ago
by
nilsec
Initializing zero-element tensors is a no-op
👍
1
3
#3 opened almost 2 years ago
by
ndurkee
HuggingFace Inference Endpoints Issue (Detailed Information)
13
#4 opened almost 2 years ago
by
blevlabs
Does Yi models have eval issues?
9
#393 opened about 2 years ago
by
migtissera
Three of my models don't show up, or have failed
5
#392 opened about 2 years ago
by
migtissera
Max Positional Embeddings
#1 opened about 2 years ago
by
ndurkee