Spaces:
Running
on
Zero
Different results when using Nielsr demo Vs running model in Colab
In Niels demo (thanks Niel!), Document Q&A chat, I upload an image and ask what is the name on the image and I get correct answer.
Running in Google Colab, I used many different prompt formats (including the one suggested) and i do not get correct answer. Anyone with similar issues or any idea why?
Any ideas how to format the prompt?
When I use Niels demo with an invoice and ask
"What is the total of the invoice?"
I get the correct answer.
When I run the kosmos-2.5 Chat model locally I do (per documentation)
question = "What is the total of the invoice?"
template = "A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the user's questions. USER: {} ASSISTANT:"
prompt = template.format(question)
And I get repetitions of “A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the user's questions” and sometimes (depending on the invoice) None or Wrong answer.