🔄 In a Training Loop
aayush garg
garg-aayush
AI & ML interests
None yet
Organizations
Training-LLMs
- Running on CPU UpgradeFeatured3.23k
The Smol Training Playbook
📚3.23kThe secrets to building world-class LLMs
- Running3.92k
The Ultra-Scale Playbook
🌌3.92kThe ultimate guide to training LLM on large GPU Clusters
- RunningFeatured1.38k
FineWeb: decanting the web for the finest text data at scale
🍷1.38kExplore and download the FineWeb web‑scale text dataset
- Running232
FineVision: Open Data is All You Need
📝232A new open-source dataset for training VLMs
RLHF Papers
-
Proximal Policy Optimization Algorithms
Paper • 1707.06347 • Published • 11 -
Direct Preference Optimization: Your Language Model is Secretly a Reward Model
Paper • 2305.18290 • Published • 66 -
DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models
Paper • 2402.03300 • Published • 148 -
DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning
Paper • 2501.12948 • Published • 455
Llama papers and reports
List of papers and reports related to llama models
LLM Tech Reports
RLHF Papers
-
Proximal Policy Optimization Algorithms
Paper • 1707.06347 • Published • 11 -
Direct Preference Optimization: Your Language Model is Secretly a Reward Model
Paper • 2305.18290 • Published • 66 -
DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models
Paper • 2402.03300 • Published • 148 -
DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning
Paper • 2501.12948 • Published • 455
Training-LLMs
- Running on CPU UpgradeFeatured3.23k
The Smol Training Playbook
📚3.23kThe secrets to building world-class LLMs
- Running3.92k
The Ultra-Scale Playbook
🌌3.92kThe ultimate guide to training LLM on large GPU Clusters
- RunningFeatured1.38k
FineWeb: decanting the web for the finest text data at scale
🍷1.38kExplore and download the FineWeb web‑scale text dataset
- Running232
FineVision: Open Data is All You Need
📝232A new open-source dataset for training VLMs
Llama papers and reports
List of papers and reports related to llama models