KingNish/reasoning-base-20k
Viewer • Updated • 19.9k • 208 • 231
How to use lunahr/thea-3b-25r-adapter with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("chuanli11/Llama-3.2-3B-Instruct-uncensored")
model = PeftModel.from_pretrained(base_model, "lunahr/thea-3b-25r-adapter")How to use lunahr/thea-3b-25r-adapter with Transformers:
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("lunahr/thea-3b-25r-adapter", dtype="auto")The LoRA adapters that pertain to 25% reasoned variant of Thea 3B.
You can merge them to your own Llama 3.2 3B, but why?
Go to the model page to find out what Thea is.
Base model
chuanli11/Llama-3.2-3B-Instruct-uncensored