flammenai
/

Mahou-1.2b-mistral-7B

Text Generation

text-generation-inference

Model card Files Files and versions

nbeerbower commited on Jun 4, 2024

Commit

5fb8a3e

·

verified ·

1 Parent(s): 5389d02

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -82,7 +82,7 @@ training_args = TrainingArguments(
     gradient_checkpointing=True,
     learning_rate=5e-5,
     lr_scheduler_type="cosine",
-    max_steps=2000,
     save_strategy="no",
     logging_steps=1,
     output_dir=new_model,

     gradient_checkpointing=True,
     learning_rate=5e-5,
     lr_scheduler_type="cosine",
+    max_steps=200,
     save_strategy="no",
     logging_steps=1,
     output_dir=new_model,