Update README.md
Browse files
README.md
CHANGED
|
@@ -7,7 +7,7 @@ tags:
|
|
| 7 |
datasets:
|
| 8 |
- HuggingFaceH4/ultrachat_200k
|
| 9 |
---
|
| 10 |
-
This is [Qwen/Qwen3-
|
| 11 |
The calibration step used 512 samples of up to 2048 tokens, chat template applied, from [HuggingFaceH4/ultrachat_200k](https://huggingface.co/datasets/HuggingFaceH4/ultrachat_200k).
|
| 12 |
|
| 13 |
The quantization has been done, tested, and evaluated by The Kaitchup.
|
|
|
|
| 7 |
datasets:
|
| 8 |
- HuggingFaceH4/ultrachat_200k
|
| 9 |
---
|
| 10 |
+
This is [Qwen/Qwen3-0.6B](https://huggingface.co/Qwen/Qwen3-0.6B) quantized with [LLM Compressor](https://github.com/vllm-project/llm-compressor) in 4-bit (NVFP4), weights and activations.
|
| 11 |
The calibration step used 512 samples of up to 2048 tokens, chat template applied, from [HuggingFaceH4/ultrachat_200k](https://huggingface.co/datasets/HuggingFaceH4/ultrachat_200k).
|
| 12 |
|
| 13 |
The quantization has been done, tested, and evaluated by The Kaitchup.
|