when using AI21-Jamba-Reasoning-3B-GGUF `Q4_K_M` in lm studio, why does the collapsible thinking ui not show?
#6
by
uptonking
- opened
- is there a better chat template file like
chat_template.jinjafor thinking?
@uptonking can you try it again in LM Studio. There were some issues with it loading that appear to be resolved now. I've been able to confirm myself that the collapsible thinking UI is working.
You can also find a prompt template on LM Studio as well: https://lmstudio.ai/models/ai21labs/jamba-reasoning-3b
If you just launch it in LM Studio, it will set default parameters :temp0.8, topK 40,minp 0.05 etc...So that mean we just use those or what?
@dheerapat38
can you verify your LM Studio settings? I ran the same prompt as yours and I am getting the reasoning in a collapsible window and then the response below that
