Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
bartowski
/
ibm-granite_granite-4.0-h-small-GGUF
like
3
Text Generation
GGUF
imatrix
conversational
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
e04908e
ibm-granite_granite-4.0-h-small-GGUF
291 GB
1 contributor
History:
14 commits
bartowski
Upload ibm-granite_granite-4.0-h-small-IQ4_XS.gguf with huggingface_hub
e04908e
verified
about 2 months ago
.gitattributes
2.55 kB
Upload ibm-granite_granite-4.0-h-small-IQ4_XS.gguf with huggingface_hub
about 2 months ago
ibm-granite_granite-4.0-h-small-IQ4_NL.gguf
Safe
18.5 GB
xet
Upload ibm-granite_granite-4.0-h-small-IQ4_NL.gguf with huggingface_hub
about 2 months ago
ibm-granite_granite-4.0-h-small-IQ4_XS.gguf
Safe
17.6 GB
xet
Upload ibm-granite_granite-4.0-h-small-IQ4_XS.gguf with huggingface_hub
about 2 months ago
ibm-granite_granite-4.0-h-small-Q4_0.gguf
18.8 GB
xet
Upload ibm-granite_granite-4.0-h-small-Q4_0.gguf with huggingface_hub
about 2 months ago
ibm-granite_granite-4.0-h-small-Q4_1.gguf
20.5 GB
xet
Upload ibm-granite_granite-4.0-h-small-Q4_1.gguf with huggingface_hub
about 2 months ago
ibm-granite_granite-4.0-h-small-Q4_K_L.gguf
19.8 GB
xet
Upload ibm-granite_granite-4.0-h-small-Q4_K_L.gguf with huggingface_hub
about 2 months ago
ibm-granite_granite-4.0-h-small-Q4_K_M.gguf
19.7 GB
xet
Upload ibm-granite_granite-4.0-h-small-Q4_K_M.gguf with huggingface_hub
about 2 months ago
ibm-granite_granite-4.0-h-small-Q4_K_S.gguf
19.1 GB
xet
Upload ibm-granite_granite-4.0-h-small-Q4_K_S.gguf with huggingface_hub
about 2 months ago
ibm-granite_granite-4.0-h-small-Q5_K_L.gguf
23.2 GB
xet
Upload ibm-granite_granite-4.0-h-small-Q5_K_L.gguf with huggingface_hub
about 2 months ago
ibm-granite_granite-4.0-h-small-Q5_K_M.gguf
23.1 GB
xet
Upload ibm-granite_granite-4.0-h-small-Q5_K_M.gguf with huggingface_hub
about 2 months ago
ibm-granite_granite-4.0-h-small-Q5_K_S.gguf
22.4 GB
xet
Upload ibm-granite_granite-4.0-h-small-Q5_K_S.gguf with huggingface_hub
about 2 months ago
ibm-granite_granite-4.0-h-small-Q6_K.gguf
26.7 GB
xet
Upload ibm-granite_granite-4.0-h-small-Q6_K.gguf with huggingface_hub
about 2 months ago
ibm-granite_granite-4.0-h-small-Q6_K_L.gguf
26.8 GB
xet
Upload ibm-granite_granite-4.0-h-small-Q6_K_L.gguf with huggingface_hub
about 2 months ago
ibm-granite_granite-4.0-h-small-Q8_0.gguf
34.3 GB
xet
Upload ibm-granite_granite-4.0-h-small-Q8_0.gguf with huggingface_hub
about 2 months ago