Reasoning text and JSON mode

#10

by sirien11 - opened Jun 18

Jun 18

Hi, I'm using this model via vllm to serve in my own gpu.

Wondering if you guys plan to implement a reasoning and json parser in vllm to process only the model answer and not manually discard think text etc.

Thanks!

tobiaslee

Jul 22

Hi there,

Thanks for your interest in our model. We don't have such a plan.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment