Suppose I have 96g vram is it possible to do fine tuning?
#22
by
win10
- opened
Suppose I have 96g vram is it possible to do fine tuning?
Yes, should be plenty for axoltl or unsloth loras.
Full parameter finetuning is probably too tight, but it's not a good idea on a single desktop card anyway. You'd want to rent a few GPUs if you need to change the model enough to warrant that.