bartowski
/

ibm-granite_granite-4.0-h-small-GGUF

Text Generation

Model card Files Files and versions

ibm-granite_granite-4.0-h-small-GGUF

393 GB

1 contributor

History: 21 commits

bartowski's picture

Upload ibm-granite_granite-4.0-h-small-IQ3_XXS.gguf with huggingface_hub

25baded verified 29 days ago

.gitattributes

3.11 kB

Upload ibm-granite_granite-4.0-h-small-IQ3_XXS.gguf with huggingface_hub 29 days ago
ibm-granite_granite-4.0-h-small-IQ3_M.gguf

15 GB
xet

Upload ibm-granite_granite-4.0-h-small-IQ3_M.gguf with huggingface_hub 29 days ago
ibm-granite_granite-4.0-h-small-IQ3_XS.gguf

13.8 GB
xet

Upload ibm-granite_granite-4.0-h-small-IQ3_XS.gguf with huggingface_hub 29 days ago
ibm-granite_granite-4.0-h-small-IQ3_XXS.gguf

13.1 GB
xet

Upload ibm-granite_granite-4.0-h-small-IQ3_XXS.gguf with huggingface_hub 29 days ago
ibm-granite_granite-4.0-h-small-IQ4_NL.gguf

18.5 GB
xet

Upload ibm-granite_granite-4.0-h-small-IQ4_NL.gguf with huggingface_hub 29 days ago
ibm-granite_granite-4.0-h-small-IQ4_XS.gguf

17.6 GB
xet

Upload ibm-granite_granite-4.0-h-small-IQ4_XS.gguf with huggingface_hub 29 days ago
ibm-granite_granite-4.0-h-small-Q3_K_L.gguf

15.6 GB
xet

Upload ibm-granite_granite-4.0-h-small-Q3_K_L.gguf with huggingface_hub 29 days ago
ibm-granite_granite-4.0-h-small-Q3_K_M.gguf

15 GB
xet

Upload ibm-granite_granite-4.0-h-small-Q3_K_M.gguf with huggingface_hub 29 days ago
ibm-granite_granite-4.0-h-small-Q3_K_S.gguf

14.4 GB
xet

Upload ibm-granite_granite-4.0-h-small-Q3_K_S.gguf with huggingface_hub 29 days ago
ibm-granite_granite-4.0-h-small-Q3_K_XL.gguf

15.7 GB
xet

Upload ibm-granite_granite-4.0-h-small-Q3_K_XL.gguf with huggingface_hub 29 days ago
ibm-granite_granite-4.0-h-small-Q4_0.gguf

18.8 GB
xet

Upload ibm-granite_granite-4.0-h-small-Q4_0.gguf with huggingface_hub 29 days ago
ibm-granite_granite-4.0-h-small-Q4_1.gguf

20.5 GB
xet

Upload ibm-granite_granite-4.0-h-small-Q4_1.gguf with huggingface_hub 29 days ago
ibm-granite_granite-4.0-h-small-Q4_K_L.gguf

19.8 GB
xet

Upload ibm-granite_granite-4.0-h-small-Q4_K_L.gguf with huggingface_hub 29 days ago
ibm-granite_granite-4.0-h-small-Q4_K_M.gguf

19.7 GB
xet

Upload ibm-granite_granite-4.0-h-small-Q4_K_M.gguf with huggingface_hub 29 days ago
ibm-granite_granite-4.0-h-small-Q4_K_S.gguf

19.1 GB
xet

Upload ibm-granite_granite-4.0-h-small-Q4_K_S.gguf with huggingface_hub 29 days ago
ibm-granite_granite-4.0-h-small-Q5_K_L.gguf

23.2 GB
xet

Upload ibm-granite_granite-4.0-h-small-Q5_K_L.gguf with huggingface_hub 29 days ago
ibm-granite_granite-4.0-h-small-Q5_K_M.gguf

23.1 GB
xet

Upload ibm-granite_granite-4.0-h-small-Q5_K_M.gguf with huggingface_hub 29 days ago
ibm-granite_granite-4.0-h-small-Q5_K_S.gguf

22.4 GB
xet

Upload ibm-granite_granite-4.0-h-small-Q5_K_S.gguf with huggingface_hub 29 days ago
ibm-granite_granite-4.0-h-small-Q6_K.gguf

26.7 GB
xet

Upload ibm-granite_granite-4.0-h-small-Q6_K.gguf with huggingface_hub 29 days ago
ibm-granite_granite-4.0-h-small-Q6_K_L.gguf

26.8 GB
xet

Upload ibm-granite_granite-4.0-h-small-Q6_K_L.gguf with huggingface_hub 29 days ago
ibm-granite_granite-4.0-h-small-Q8_0.gguf

34.3 GB
xet

Upload ibm-granite_granite-4.0-h-small-Q8_0.gguf with huggingface_hub 29 days ago