Upload folder using huggingface_hub

README.md

@@ -0,0 +1,36 @@
+---
+license: apache-2.0
+tags:
+- merge
+- mergekit
+- lazymergekit
+- TinyLlama/TinyLlama-1.1B-Chat-v1.0
+- l3utterfly/tinyllama-1.1b-layla-v1
+---
+
+# TinyLlama-1.1B-chat-ties-v1
+
+TinyLlama-1.1B-chat-ties-v1 is a merge of the following models using [mergekit](https://github.com/cg123/mergekit):
+* [TinyLlama/TinyLlama-1.1B-Chat-v1.0](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0)
+* [l3utterfly/tinyllama-1.1b-layla-v1](https://huggingface.co/l3utterfly/tinyllama-1.1b-layla-v1)
+
+## 🧩 Configuration
+
+```yaml
+models:
+  - model: TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T
+    # no parameters necessary for base model
+  - model: TinyLlama/TinyLlama-1.1B-Chat-v1.0
+    parameters:
+      density: 0.5
+      weight: 0.5
+  - model: l3utterfly/tinyllama-1.1b-layla-v1
+    parameters:
+      density: 0.5
+      weight: 0.3
+merge_method: ties
+base_model: TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T
+parameters:
+  normalize: true
+dtype: bfloat16
+```