Text Generation
Transformers
Safetensors
mixtral
Mixture of Experts
DPO
RL-TUNED
text-generation-inference
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM
tokenizer = AutoTokenizer.from_pretrained("yunconglong/13B_MATH_DPO")
model = AutoModelForCausalLM.from_pretrained("yunconglong/13B_MATH_DPO")Quick Links
- DPO Trainer with dataset kyujinpy/orca_math_dpo to improve [yunconglong/MoE_13B_DPO]
DPO Trainer TRL supports the DPO Trainer for training language models from preference data, as described in the paper Direct Preference Optimization: Your Language Model is Secretly a Reward Model by Rafailov et al., 2023.
- Downloads last month
- 64
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="yunconglong/13B_MATH_DPO")