Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

894

Base only

Active filters: ppo, trl

Dr3dre/ppo-short-sentence-repeat-pythia-1b-deduped-lr2e-06-effbs64-ep1-0-noise-10

Text Generation • 1B • Updated Feb 21 • 15

Dr3dre/ppo-short-sentence-repeat-pythia-1b-deduped-lr2e-06-effbs64-ep1-0-noise-50

Text Generation • 1B • Updated Feb 21 • 9

Dr3dre/ppo-short-sentence-repeat-pythia-1b-deduped-lr2e-06-effbs64-ep1-0-noise-70

Text Generation • 1B • Updated Feb 21 • 9

abhinav-gothwal-safe-gen-ai/gpt2-ppo-full-safe

Reinforcement Learning • 0.4B • Updated Feb 25 • 2

Amogh06/PPO-FFT-SafeGenAI

Reinforcement Learning • 0.4B • Updated Feb 26 • 2

thrnn/ppo-gpt2-medium-qlora

Reinforcement Learning • Updated Feb 28 • 3

thrnn/ppo-gpt2-medium-lora

Reinforcement Learning • Updated Feb 28 • 3

thrnn/ppo-gpt2-medium-full

Reinforcement Learning • 0.4B • Updated Feb 28 • 2

thrnn/ppo-gpt2-medium-qlora-backup

Reinforcement Learning • Updated Feb 28 • 1

thrnn/ppo-gpt2-medium-prefix-backup

Reinforcement Learning • Updated Feb 28 • 2

thrnn/ppo-gpt2-medium-prefix

Reinforcement Learning • Updated Feb 28 • 2

anirvankrishna/TaskA_Full_Finetune

Reinforcement Learning • 0.4B • Updated Feb 28 • 3

anirvankrishna/TaskA_LoRA_Finetune

Reinforcement Learning • Updated Mar 1 • 1

anirvankrishna/TaskA_Prefix_Finetune

Reinforcement Learning • Updated Mar 1 • 4

anirvankrishna/TaskA_QLoRA_Finetune

Reinforcement Learning • Updated Mar 2 • 2

mxcui/maxmin-imdb-ppo-prop0.01-seed42

Text Generation • 0.2B • Updated Mar 11 • 9

mxcui/maxmin-imdb-ppo-prop0.05-seed42

Text Generation • 0.2B • Updated Mar 11 • 11

mxcui/maxmin-imdb-ppo-prop0.1-seed42

Text Generation • 0.2B • Updated Mar 11 • 9

dnithin/mistral-7b-ppo-llama-judge

Reinforcement Learning • Updated Mar 13 • 2

dnithin/mistral-7b-ppo-mistral-judge

Reinforcement Learning • Updated Mar 14 • 2

Misha0706/llm-alignment-ppo

Text Generation • 0.1B • Updated Apr 13 • 8

chungimungi/llama3-ppo

Igriscodes/qwen3-1.7b-tool

Text Generation • 2B • Updated May 19

Igriscodes/qwen3-4b-tool

Text Generation • 4B • Updated May 21 • 1

khangtq/ppo_qwen3_checkpoint

Text Generation • 2B • Updated May 28 • 6

khangtq/ppo_qwen3_checkpoint-v1

Text Generation • 2B • Updated May 29 • 7

yavuz-ai/ppo

sarimahsan101/ppo-gpt2-imdb

Text Generation • 0.1B • Updated Jul 10 • 186

mxcui/sumgrad-imdb-ppo-prop0.2-alpha1.1-seed42-mean_kl0.1-gpt2

Text Generation • 0.1B • Updated Jul 11 • 97

mxcui/sumgrad-imdb-ppo-prop0.2-alpha0.6-seed42-mean_kl0.1-gpt2

Text Generation • 0.1B • Updated Jul 11 • 114