bartowski
/

ibm-granite_granite-4.0-h-small-GGUF

Text Generation

Model card Files Files and versions

ibm-granite_granite-4.0-h-small-GGUF

454 GB

1 contributor

History: 27 commits

bartowski's picture

Upload ibm-granite_granite-4.0-h-small-IQ2_XXS.gguf with huggingface_hub

729ec8a verified about 2 months ago

.gitattributes

3.59 kB

Upload ibm-granite_granite-4.0-h-small-IQ2_XXS.gguf with huggingface_hub about 2 months ago
ibm-granite_granite-4.0-h-small-IQ2_M.gguf

10.5 GB
xet

Upload ibm-granite_granite-4.0-h-small-IQ2_M.gguf with huggingface_hub about 2 months ago
ibm-granite_granite-4.0-h-small-IQ2_S.gguf

9.3 GB
xet

Upload ibm-granite_granite-4.0-h-small-IQ2_S.gguf with huggingface_hub about 2 months ago
ibm-granite_granite-4.0-h-small-IQ2_XS.gguf

9.29 GB
xet

Upload ibm-granite_granite-4.0-h-small-IQ2_XS.gguf with huggingface_hub about 2 months ago
ibm-granite_granite-4.0-h-small-IQ2_XXS.gguf

8.15 GB
xet

Upload ibm-granite_granite-4.0-h-small-IQ2_XXS.gguf with huggingface_hub about 2 months ago
ibm-granite_granite-4.0-h-small-IQ3_M.gguf

15 GB
xet

Upload ibm-granite_granite-4.0-h-small-IQ3_M.gguf with huggingface_hub about 2 months ago
ibm-granite_granite-4.0-h-small-IQ3_XS.gguf

13.8 GB
xet

Upload ibm-granite_granite-4.0-h-small-IQ3_XS.gguf with huggingface_hub about 2 months ago
ibm-granite_granite-4.0-h-small-IQ3_XXS.gguf

13.1 GB
xet

Upload ibm-granite_granite-4.0-h-small-IQ3_XXS.gguf with huggingface_hub about 2 months ago
ibm-granite_granite-4.0-h-small-IQ4_NL.gguf

18.5 GB
xet

Upload ibm-granite_granite-4.0-h-small-IQ4_NL.gguf with huggingface_hub about 2 months ago
ibm-granite_granite-4.0-h-small-IQ4_XS.gguf

17.6 GB
xet

Upload ibm-granite_granite-4.0-h-small-IQ4_XS.gguf with huggingface_hub about 2 months ago
ibm-granite_granite-4.0-h-small-Q2_K.gguf

11.7 GB
xet

Upload ibm-granite_granite-4.0-h-small-Q2_K.gguf with huggingface_hub about 2 months ago
ibm-granite_granite-4.0-h-small-Q2_K_L.gguf

11.8 GB
xet

Upload ibm-granite_granite-4.0-h-small-Q2_K_L.gguf with huggingface_hub about 2 months ago
ibm-granite_granite-4.0-h-small-Q3_K_L.gguf

15.6 GB
xet

Upload ibm-granite_granite-4.0-h-small-Q3_K_L.gguf with huggingface_hub about 2 months ago
ibm-granite_granite-4.0-h-small-Q3_K_M.gguf

15 GB
xet

Upload ibm-granite_granite-4.0-h-small-Q3_K_M.gguf with huggingface_hub about 2 months ago
ibm-granite_granite-4.0-h-small-Q3_K_S.gguf

14.4 GB
xet

Upload ibm-granite_granite-4.0-h-small-Q3_K_S.gguf with huggingface_hub about 2 months ago
ibm-granite_granite-4.0-h-small-Q3_K_XL.gguf

15.7 GB
xet

Upload ibm-granite_granite-4.0-h-small-Q3_K_XL.gguf with huggingface_hub about 2 months ago
ibm-granite_granite-4.0-h-small-Q4_0.gguf

18.8 GB
xet

Upload ibm-granite_granite-4.0-h-small-Q4_0.gguf with huggingface_hub about 2 months ago
ibm-granite_granite-4.0-h-small-Q4_1.gguf

20.5 GB
xet

Upload ibm-granite_granite-4.0-h-small-Q4_1.gguf with huggingface_hub about 2 months ago
ibm-granite_granite-4.0-h-small-Q4_K_L.gguf

19.8 GB
xet

Upload ibm-granite_granite-4.0-h-small-Q4_K_L.gguf with huggingface_hub about 2 months ago
ibm-granite_granite-4.0-h-small-Q4_K_M.gguf

19.7 GB
xet

Upload ibm-granite_granite-4.0-h-small-Q4_K_M.gguf with huggingface_hub about 2 months ago
ibm-granite_granite-4.0-h-small-Q4_K_S.gguf

19.1 GB
xet

Upload ibm-granite_granite-4.0-h-small-Q4_K_S.gguf with huggingface_hub about 2 months ago
ibm-granite_granite-4.0-h-small-Q5_K_L.gguf

23.2 GB
xet

Upload ibm-granite_granite-4.0-h-small-Q5_K_L.gguf with huggingface_hub about 2 months ago
ibm-granite_granite-4.0-h-small-Q5_K_M.gguf

23.1 GB
xet

Upload ibm-granite_granite-4.0-h-small-Q5_K_M.gguf with huggingface_hub about 2 months ago
ibm-granite_granite-4.0-h-small-Q5_K_S.gguf

22.4 GB
xet

Upload ibm-granite_granite-4.0-h-small-Q5_K_S.gguf with huggingface_hub about 2 months ago
ibm-granite_granite-4.0-h-small-Q6_K.gguf

26.7 GB
xet

Upload ibm-granite_granite-4.0-h-small-Q6_K.gguf with huggingface_hub about 2 months ago
ibm-granite_granite-4.0-h-small-Q6_K_L.gguf

26.8 GB
xet

Upload ibm-granite_granite-4.0-h-small-Q6_K_L.gguf with huggingface_hub about 2 months ago
ibm-granite_granite-4.0-h-small-Q8_0.gguf

34.3 GB
xet

Upload ibm-granite_granite-4.0-h-small-Q8_0.gguf with huggingface_hub about 2 months ago