pyamy
/

llama3-dpo-llm-judge

preference-learning

Model card Files Files and versions

Metrics Training metrics Community

llama3-dpo-llm-judge

241 MB

1 contributor

History: 12 commits

pyamy's picture

Upload DPO LLM Judge fine-tuned model

d781aad verified 4 months ago

checkpoint-100
Upload DPO LLM Judge fine-tuned model 4 months ago
checkpoint-150
Upload DPO LLM Judge fine-tuned model 4 months ago
checkpoint-200
Upload DPO LLM Judge fine-tuned model 4 months ago
checkpoint-250
Upload DPO LLM Judge fine-tuned model 4 months ago
checkpoint-50
Upload DPO LLM Judge fine-tuned model 4 months ago
checkpoint-500
Upload DPO LLM Judge fine-tuned model 4 months ago
runs
Upload DPO LLM Judge fine-tuned model 4 months ago
.gitattributes

1.97 kB

Upload DPO LLM Judge fine-tuned model 4 months ago
README.md

2.5 kB

Upload DPO LLM Judge fine-tuned model 4 months ago
adapter_config.json

932 Bytes

Upload DPO LLM Judge fine-tuned model 4 months ago
adapter_model.safetensors

6.83 MB
xet

Upload DPO LLM Judge fine-tuned model 4 months ago
chat_template.jinja

3.92 kB

Upload DPO LLM Judge fine-tuned model 4 months ago
special_tokens_map.json

342 Bytes

Upload DPO LLM Judge fine-tuned model 4 months ago
tokenizer.json

17.2 MB
xet

Upload DPO LLM Judge fine-tuned model 4 months ago
tokenizer_config.json

52.6 kB

Upload DPO LLM Judge fine-tuned model 4 months ago
training_args.bin
Detected Pickle imports (11)
- "accelerate.state.PartialState",
- "transformers.trainer_utils.IntervalStrategy",
- "transformers.trainer_utils.SchedulerType",
- "trl.trainer.dpo_config.FDivergenceType",
- "transformers.trainer_utils.HubStrategy",
- "transformers.trainer_utils.SaveStrategy",
- "trl.trainer.dpo_config.DPOConfig",
- "transformers.training_args.OptimizerNames",
- "torch.device",
- "transformers.trainer_pt_utils.AcceleratorConfig",
- "accelerate.utils.dataclasses.DistributedType"
How to fix it?
6.26 kB
xet

Upload DPO LLM Judge fine-tuned model 4 months ago
training_history.json

219 Bytes

Upload DPO LLM Judge fine-tuned model 4 months ago
training_metrics.json

13 kB

Upload DPO LLM Judge fine-tuned model 4 months ago