when using AI21-Jamba-Reasoning-3B-GGUF `Q4_K_M` in lm studio, why does the collapsible thinking ui not show?

#6
by uptonking - opened
  • is there a better chat template file like chat_template.jinja for thinking?
AI21 org

@uptonking can you try it again in LM Studio. There were some issues with it loading that appear to be resolved now. I've been able to confirm myself that the collapsible thinking UI is working.

You can also find a prompt template on LM Studio as well: https://lmstudio.ai/models/ai21labs/jamba-reasoning-3b

If you just launch it in LM Studio, it will set default parameters :temp0.8, topK 40,minp 0.05 etc...So that mean we just use those or what?

AI21 org

@urtuuuu you can adjust these parameters to your liking in the loaded model settings in LM Studio (Click wrench in upper right corner -> Select model tab)

Mine the reasoning section is not displayed

image

It just answered all in the single long text with no tag

AI21 org

@dheerapat38 can you verify your LM Studio settings? I ran the same prompt as yours and I am getting the reasoning in a collapsible window and then the response below that
SCR-20251013-jqmm

Sign up or log in to comment