PEFT (Parameter Efficient Fine-Tuning) PEFT (Parameter-Efficient Fine-Tuning): PEFT is a technique that focuses on updating only a small subset of the model’s parameters during fine-tuning. thsluck/llm-course-hw3-lora Text Generation • 0.3B • Updated Apr 11, 2025 • 1 LoRA: Low-Rank Adaptation of Large Language Models Paper • 2106.09685 • Published Jun 17, 2021 • 61 thsluck/llm-course-hw3-dora Text Generation • 0.3B • Updated Apr 11, 2025 • 2 DoRA: Weight-Decomposed Low-Rank Adaptation Paper • 2402.09353 • Published Feb 14, 2024 • 33
PEFT (Parameter Efficient Fine-Tuning) PEFT (Parameter-Efficient Fine-Tuning): PEFT is a technique that focuses on updating only a small subset of the model’s parameters during fine-tuning. thsluck/llm-course-hw3-lora Text Generation • 0.3B • Updated Apr 11, 2025 • 1 LoRA: Low-Rank Adaptation of Large Language Models Paper • 2106.09685 • Published Jun 17, 2021 • 61 thsluck/llm-course-hw3-dora Text Generation • 0.3B • Updated Apr 11, 2025 • 2 DoRA: Weight-Decomposed Low-Rank Adaptation Paper • 2402.09353 • Published Feb 14, 2024 • 33
