1 3 23

EZ

enpeizhao

AI & ML interests

Autonomous Driving, VLM, LLM, end-to-end

Recent Activity

updated a model 3 days ago

enpeizhao/qwen3-2b-instruct-trl-sft-30-bf16-merged

updated a model 3 days ago

enpeizhao/qwen3-2b-instruct-trl-sft-30-bf16_adapter

reacted to sergiopaniego's post with 🔥 9 days ago

New GRPO + TRL free Colab notebook out! 🔥 Fine-tune 7B+ models on T4 GPUs thanks to a ton of memory optimizations for GRPO 7B model uses only 9.2 GB VRAM (~7× reduction) 🤯 Try the notebook here 👉 https://colab.research.google.com/github/huggingface/trl/blob/main/examples/notebooks/grpo_trl_lora_qlora.ipynb

View all activity

Organizations

None yet

updated 2 models 3 days ago

enpeizhao/qwen3-2b-instruct-trl-sft-30-bf16-merged

Image-to-Text • 1B • Updated 3 days ago • 11

enpeizhao/qwen3-2b-instruct-trl-sft-30-bf16_adapter

Updated 3 days ago

reacted to sergiopaniego's post with 🔥 9 days ago

Post

2217

New GRPO + TRL free Colab notebook out! 🔥

Fine-tune 7B+ models on T4 GPUs thanks to a ton of memory optimizations for GRPO

7B model uses only 9.2 GB VRAM (~7× reduction) 🤯

Try the notebook here 👉 https://colab.research.google.com/github/huggingface/trl/blob/main/examples/notebooks/grpo_trl_lora_qlora.ipynb

reacted to sergiopaniego's post with 🔥 9 days ago

Post

2572

The list of hands-on notebooks (some beginner-friendly!) to get started with fine-tuning using TRL keeps growing!!

• SFT
• GRPO
• Tool calling & agents
• RL environments with OpenEnv
• LLMs and VLMs
✨ Many run on FREE Colab, making it super easy to get started fast!

https://github.com/huggingface/trl/tree/main/examples/notebooks