Sourab Mangrulkar

smangrul's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

published an article over 1 year ago

view article

Article

GaLore: Advancing Large Model Training on Consumer-grade Hardware

• 

Mar 20, 2024

•

32

published an article almost 2 years ago

view article

Article

🤗 PEFT welcomes new merging methods

• 

Feb 19, 2024

•

24

published an article almost 2 years ago

view article

Article

Mixture of Experts Explained

• 

Dec 11, 2023

•

969

published an article about 2 years ago

view article

Article

Personal Copilot: Train Your Own Coding Assistant

• 

Oct 27, 2023

•

73

published an article about 2 years ago

view article

Article

Fine-tuning Llama 2 70B using PyTorch FSDP

• 

Sep 13, 2023

•

30

published an article over 2 years ago

view article

Article

The Falcon has landed in the Hugging Face ecosystem

• 

Jun 5, 2023

•

17

published an article over 2 years ago

view article

Article

Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA

• 

May 24, 2023

•

169

published an article over 2 years ago

view article

Article

Fine-tuning 20B LLMs with RLHF on a 24GB consumer GPU

• 

Mar 9, 2023

•

68

published an article almost 3 years ago

view article

Article

Parameter-Efficient Fine-Tuning using 🤗 PEFT

• 

Feb 10, 2023

•

107

published an article over 3 years ago

view article

Article

Accelerate Large Model Training using DeepSpeed

• 

Jun 28, 2022

•

6

published an article over 3 years ago

view article

Article

Accelerate Large Model Training using PyTorch Fully Sharded Data Parallel

• 

May 2, 2022

•

9