AIFunOver
/

Qwen2.5-14B-Instruct-1M-openvino-4bit

Text Generation

4-bit precision

text-generation-inference

Model card Files Files and versions

Qwen2.5-14B-Instruct-1M-openvino-4bit

8.7 GB

1 contributor

History: 15 commits

AIFunOver's picture

Upload sparse_attention_config.json with huggingface_hub

24846a5 verified 10 months ago

.gitattributes

1.52 kB

initial commit 10 months ago
config.json

876 Bytes

Upload config.json with huggingface_hub 10 months ago
generation_config.json

243 Bytes

Upload generation_config.json with huggingface_hub 10 months ago
model.safetensors.index.json

47.5 kB

Upload model.safetensors.index.json with huggingface_hub 10 months ago
openvino_config.json

651 Bytes

Upload openvino_config.json with huggingface_hub 10 months ago
openvino_detokenizer.bin

1.58 MB
xet

Upload openvino_detokenizer.bin with huggingface_hub 10 months ago
openvino_detokenizer.xml

11.1 kB

Upload openvino_detokenizer.xml with huggingface_hub 10 months ago
openvino_model.bin

8.68 GB
xet

Upload openvino_model.bin with huggingface_hub 10 months ago
openvino_model.xml

4.38 MB

Upload openvino_model.xml with huggingface_hub 10 months ago
openvino_tokenizer.bin

3.77 MB
xet

Upload openvino_tokenizer.bin with huggingface_hub 10 months ago
openvino_tokenizer.xml

24.8 kB

Upload openvino_tokenizer.xml with huggingface_hub 10 months ago
sparse_attention_config.json

118 kB

Upload sparse_attention_config.json with huggingface_hub 10 months ago
tokenizer.json

7.03 MB

Upload tokenizer.json with huggingface_hub 10 months ago
tokenizer_config.json

7.23 kB

Upload tokenizer_config.json with huggingface_hub 10 months ago
vocab.json

2.78 MB

Upload vocab.json with huggingface_hub 10 months ago