annay3294
/

trainer_output

Text Generation

Generated from Trainer

text-generation-inference

Model card Files Files and versions

Metrics Training metrics Community

annay3294 commited on Mar 30

Commit

591c437

·

verified ·

1 Parent(s): 5a58d69

End of training

Files changed (3) hide show

README.md +2 -2
model.safetensors +1 -1
training_args.bin +1 -1

README.md CHANGED Viewed

@@ -2,7 +2,7 @@
 base_model: HuggingFaceTB/SmolLM-135M-Instruct
 datasets: HumanLLMs/Human-Like-DPO-Dataset
 library_name: transformers
-model_name: trainer_output
 tags:
 - generated_from_trainer
 - trl
@@ -10,7 +10,7 @@ tags:
 licence: license
 ---
-# Model Card for trainer_output
 This model is a fine-tuned version of [HuggingFaceTB/SmolLM-135M-Instruct](https://huggingface.co/HuggingFaceTB/SmolLM-135M-Instruct) on the [HumanLLMs/Human-Like-DPO-Dataset](https://huggingface.co/datasets/HumanLLMs/Human-Like-DPO-Dataset) dataset.
 It has been trained using [TRL](https://github.com/huggingface/trl).

 base_model: HuggingFaceTB/SmolLM-135M-Instruct
 datasets: HumanLLMs/Human-Like-DPO-Dataset
 library_name: transformers
+model_name: annay3294/llm-course-hw2-reward-model
 tags:
 - generated_from_trainer
 - trl
 licence: license
 ---
+# Model Card for annay3294/llm-course-hw2-reward-model
 This model is a fine-tuned version of [HuggingFaceTB/SmolLM-135M-Instruct](https://huggingface.co/HuggingFaceTB/SmolLM-135M-Instruct) on the [HumanLLMs/Human-Like-DPO-Dataset](https://huggingface.co/datasets/HumanLLMs/Human-Like-DPO-Dataset) dataset.
 It has been trained using [TRL](https://github.com/huggingface/trl).

model.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:6317661ca165840e367ee13a01154b634e8de2d052b12e31e3044d9ef5b27c01
 size 538092792

 version https://git-lfs.github.com/spec/v1
+oid sha256:65533307bfe7df64c014f52a265af4e616bacff0fc092ec1d58b095ff6148c7e
 size 538092792

training_args.bin CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:4168e6b7bb5ada750c3145e49b95caaa73ead5bb36a47c578dbc9d6329ae4b24
 size 5432

 version https://git-lfs.github.com/spec/v1
+oid sha256:bea79283a2116ad3a2e77acd224a666ac52ded02dacf45e2c68f140f8a100355
 size 5432