Is thinking turned off by default?
#3
by
Fernanda24
- opened
when i run the offical fp8 repo thinking is on by default but after loading this one up with exact same command basically in sglang thinking seems to be off?
oh and further more it doesnt stop generating response it just goes on and on hmm maybe i did something wrong?