Ollama Upload Image to Model

[daniel156161]

What happened?

Try to get a answer whats is in a Image with Ollama and the LLAVA model

Steps to Reproduce

1. Docker-Compose install with Ollama
2. ollama pull llava
3. Custom Config with Ollama
4. Upload Image file into Ollama Chat

What browsers are you seeing the problem on?

Chrome

Relevant log output

api Service:
2024-04-23 08:13:44 warn: [OpenAIClient.chatCompletion][stream] API error
2024-04-23 08:13:44 error: [handleAbortError] AI response error; aborting request: 400 json: cannot unmarshal array into Go struct field Message.messages.content of type string

ollama service:
[GIN] 2024/04/23 - 08:13:44 | 400 |     985.868µs |    192.168.32.7 | POST     "/v1/chat/completions"

Screenshots

Code of Conduct

• I agree to follow this project's Code of Conduct

[danny-avila]

It's an Ollama limitation at the moment. Please let them know you would like to see this implemented: ollama/ollama#3690

[danny-avila]

I'm not sure Ollama will implement this, so I decided to add it: