Different results when using Nielsr demo Vs running model in Colab

#1
by konstantis - opened

In Niels demo (thanks Niel!), Document Q&A chat, I upload an image and ask what is the name on the image and I get correct answer.
Running in Google Colab, I used many different prompt formats (including the one suggested) and i do not get correct answer. Anyone with similar issues or any idea why?

Any ideas how to format the prompt?

When I use Niels demo with an invoice and ask
"What is the total of the invoice?"
I get the correct answer.

When I run the kosmos-2.5 Chat model locally I do (per documentation)
question = "What is the total of the invoice?"
template = "A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the user's questions. USER: {} ASSISTANT:"
prompt = template.format(question)

And I get repetitions of “A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the user's questions” and sometimes (depending on the invoice) None or Wrong answer.

Sign up or log in to comment