jessemeng
/

TwinLlama-3.2-1B-DPO

Text Generation

text-generation-inference

Model card Files Files and versions

Uploaded model

Developed by: jessemeng
License: apache-2.0
Finetuned from model : jessemeng/TwinLlama-3.2-1B

This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.

Downloads last month: 4

Safetensors

Model size

1B params

Tensor type

F16

·

Model tree for jessemeng/TwinLlama-3.2-1B-DPO

Base model

meta-llama/Llama-3.2-1B

Finetuned

unsloth/Llama-3.2-1B

Finetuned

jessemeng/TwinLlama-3.2-1B

Finetuned

(1)

this model

Quantizations

1 model