mradermacher
/

Llama-3.1-Nemotron-Nano-4B-v1.1-i1-GGUF

Model card Files Files and versions

Llama-3.1-Nemotron-Nano-4B-v1.1-i1-GGUF

53.7 GB

1 contributor

History: 7 commits

mradermacher's picture

auto-patch README.md

06bb8ed verified 4 months ago

.gitattributes

3.55 kB

uploaded from rain 5 months ago
Llama-3.1-Nemotron-Nano-4B-v1.1.i1-IQ1_M.gguf

1.29 GB
xet

uploaded from rain 5 months ago
Llama-3.1-Nemotron-Nano-4B-v1.1.i1-IQ1_S.gguf

1.21 GB
xet

uploaded from rain 5 months ago
Llama-3.1-Nemotron-Nano-4B-v1.1.i1-IQ2_M.gguf

1.72 GB
xet

uploaded from rain 5 months ago
Llama-3.1-Nemotron-Nano-4B-v1.1.i1-IQ2_S.gguf

1.63 GB
xet

uploaded from rain 5 months ago
Llama-3.1-Nemotron-Nano-4B-v1.1.i1-IQ2_XS.gguf

1.52 GB
xet

uploaded from rain 5 months ago
Llama-3.1-Nemotron-Nano-4B-v1.1.i1-IQ2_XXS.gguf

1.41 GB
xet

uploaded from rain 5 months ago
Llama-3.1-Nemotron-Nano-4B-v1.1.i1-IQ3_M.gguf

2.18 GB
xet

uploaded from rain 5 months ago
Llama-3.1-Nemotron-Nano-4B-v1.1.i1-IQ3_S.gguf

2.11 GB
xet

uploaded from rain 5 months ago
Llama-3.1-Nemotron-Nano-4B-v1.1.i1-IQ3_XS.gguf

2.03 GB
xet

uploaded from rain 5 months ago
Llama-3.1-Nemotron-Nano-4B-v1.1.i1-IQ3_XXS.gguf

1.88 GB
xet

uploaded from rain 5 months ago
Llama-3.1-Nemotron-Nano-4B-v1.1.i1-IQ4_NL.gguf

2.66 GB
xet

uploaded from rain 5 months ago
Llama-3.1-Nemotron-Nano-4B-v1.1.i1-IQ4_XS.gguf

2.54 GB
xet

uploaded from rain 5 months ago
Llama-3.1-Nemotron-Nano-4B-v1.1.i1-Q2_K.gguf

1.84 GB
xet

uploaded from rain 5 months ago
Llama-3.1-Nemotron-Nano-4B-v1.1.i1-Q2_K_S.gguf

1.73 GB
xet

uploaded from rain 5 months ago
Llama-3.1-Nemotron-Nano-4B-v1.1.i1-Q3_K_L.gguf

2.46 GB
xet

uploaded from rain 5 months ago
Llama-3.1-Nemotron-Nano-4B-v1.1.i1-Q3_K_M.gguf

2.3 GB
xet

uploaded from rain 5 months ago
Llama-3.1-Nemotron-Nano-4B-v1.1.i1-Q3_K_S.gguf

2.1 GB
xet

uploaded from rain 5 months ago
Llama-3.1-Nemotron-Nano-4B-v1.1.i1-Q4_0.gguf

2.66 GB
xet

uploaded from rain 5 months ago
Llama-3.1-Nemotron-Nano-4B-v1.1.i1-Q4_1.gguf

2.91 GB
xet

uploaded from rain 5 months ago
Llama-3.1-Nemotron-Nano-4B-v1.1.i1-Q4_K_M.gguf

2.78 GB
xet

uploaded from rain 5 months ago
Llama-3.1-Nemotron-Nano-4B-v1.1.i1-Q4_K_S.gguf

2.66 GB
xet

uploaded from rain 5 months ago
Llama-3.1-Nemotron-Nano-4B-v1.1.i1-Q5_K_M.gguf

3.23 GB
xet

uploaded from rain 5 months ago
Llama-3.1-Nemotron-Nano-4B-v1.1.i1-Q5_K_S.gguf

3.16 GB
xet

uploaded from rain 5 months ago
Llama-3.1-Nemotron-Nano-4B-v1.1.i1-Q6_K.gguf

3.71 GB
xet

uploaded from rain 5 months ago
README.md

6.54 kB

auto-patch README.md 4 months ago
imatrix.dat

3.68 MB
xet

uploaded from rain 5 months ago