*solved*LLaVA/bakllava/moondream Custom Modelfile doesn't produce related answers with the image #1990
kasimacikbas
started this conversation in
General
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Bug Report
Description
I found the issue... I accidentally put 1 doublequotes missing in the system parameter and laughing myself very hard.
Bug Summary:
LLaVA/bakllava/moondream Custom Modelfile doesn't produce related answers with the image I uploaded. Without creating a custom modelfile it works without any problem, but as soon as I type system prompt it starts giving random answers.
Steps to Reproduce:
1- Create a modelfile selecting LLaVA:7b or baklava:7b or moondream
2- As the system prompt try something identical, mine was 'start your response with AHOY'
3- Open modelfile and type something without uploading an image. It will start the response with AHOY
4- Upload an image and say 'analyze', the response will be totally random and irrelevant to the image.
Expected Behavior:
should use the system prompt when analyzing the images. In this case it should start image description with 'AHOY'
Actual Behavior:
Image description is totally random
Environment
Open WebUI Version: v0.1.123
Ollama (if applicable): 0.1.33
Operating System: Windows 11
Browser (if applicable): Chrome 124.0.6367.119
## Reproduction Details
Confirmation:
Screenshots
Installation Method
I installed the Open WebUI using Pinokio by CocktailPeanut.
Beta Was this translation helpful? Give feedback.
All reactions