turboderp
/

command-r-plus-103B-exl2

Model card Files Files and versions

turboderp commited on Apr 10, 2024

Commit

314a663

·

verified ·

1 Parent(s): c8ca121

Update config.json

Files changed (1) hide show

config.json +1 -0

config.json CHANGED Viewed

@@ -13,6 +13,7 @@
     "layer_norm_eps": 1e-05,
     "logit_scale": 0.8333333333333334,
     "max_position_embeddings": 8192,
     "model_type": "cohere",
     "num_attention_heads": 96,
     "num_hidden_layers": 64,

     "layer_norm_eps": 1e-05,
     "logit_scale": 0.8333333333333334,
     "max_position_embeddings": 8192,
+    "model_max_length": 131072,
     "model_type": "cohere",
     "num_attention_heads": 96,
     "num_hidden_layers": 64,