Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
RedHatAI
/
Apertus-70B-Instruct-2509-quantized.w4a16
like
1
Follow
Red Hat AI
1.67k
Text Generation
Transformers
Safetensors
apertus
multilingual
compliant
swiss-ai
fp8
vllm
compressed-tensors
llm-compressor
conversational
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
Apertus-70B-Instruct-2509-quantized.w4a16
/
generation_config.json
alexmarques
Upload folder using huggingface_hub
eead3b9
verified
2 months ago
raw
Copy download link
history
blame
contribute
delete
Safe
137 Bytes
{
"_from_model_config"
:
true
,
"bos_token_id"
:
1
,
"eos_token_id"
:
[
2
,
68
,
72
]
,
"transformers_version"
:
"4.56.1"
}