Update README.md
Browse files
README.md
CHANGED
|
@@ -13,7 +13,7 @@ tags:
|
|
| 13 |
---
|
| 14 |
# Gemma Advanced V2.1 - GGUF Quants
|
| 15 |
|
| 16 |
-
This is a merge of the 'smartest' advanced fine-tunes available for Gemma-2-9b-it.
|
| 17 |
|
| 18 |
## Notes and observations:
|
| 19 |
* The extreme temperature sensitivity from V1 has been fixed, no longer needs to be run at lower temperatures
|
|
@@ -26,8 +26,6 @@ This is a merge of the 'smartest' advanced fine-tunes available for Gemma-2-9b-i
|
|
| 26 |
* I'm looking for a job, if you're hiring. I'm a skilled Python developer who brings strong devops skills along with an ever-growing knowledge of machine learning pipelines and models. Message me if you want to talk about what I can bring to your team.
|
| 27 |
* Overall, this feels like a very useful and successful merge.
|
| 28 |
|
| 29 |
-
GGUFs here: https://huggingface.co/jsgreenawalt/gemma-2-9B-it-advanced-v2.1-GGUF
|
| 30 |
-
|
| 31 |
# sample ollama Modelfile
|
| 32 |
```yaml
|
| 33 |
FROM /path/to/file/gemma-2-9B-it-advanced-v2.1-Q8_0.gguf
|
|
|
|
| 13 |
---
|
| 14 |
# Gemma Advanced V2.1 - GGUF Quants
|
| 15 |
|
| 16 |
+
This is a merge of the 'smartest' advanced fine-tunes available for Gemma-2-9b-it. It includes WPO, SimPO, and SPPO. The merge was performed via the SOTA 'della' merge method. Merge parameters have been hand-tuned for best results. The Q8_0 quant is highly recommended. I'll link to other quants as they appear.
|
| 17 |
|
| 18 |
## Notes and observations:
|
| 19 |
* The extreme temperature sensitivity from V1 has been fixed, no longer needs to be run at lower temperatures
|
|
|
|
| 26 |
* I'm looking for a job, if you're hiring. I'm a skilled Python developer who brings strong devops skills along with an ever-growing knowledge of machine learning pipelines and models. Message me if you want to talk about what I can bring to your team.
|
| 27 |
* Overall, this feels like a very useful and successful merge.
|
| 28 |
|
|
|
|
|
|
|
| 29 |
# sample ollama Modelfile
|
| 30 |
```yaml
|
| 31 |
FROM /path/to/file/gemma-2-9B-it-advanced-v2.1-Q8_0.gguf
|