"Event not found in queue" when deploying Gradio behind a proxy #8074
Comments
|
Hi @shaojun are you installing Gradio on multiple replicas? Or can you tell us more about how this Gradio app is deployed? |
I just run with vscode debug as started with single python file, in my laptop. |
|
This is super strange, I would not have expected this error. Can you try a fresh installation of gradio using cc @aliabid94 if you have any ideas |
|
I do install the gradio by pip though i am using miniconda. |
|
Ah yeah is it possible for you test without the proxy set? |
|
I have |
|
you can try |
|
I am also encountering this issue, running Gradio on Kubernetes with Ray Serve and a single replica: Here is the serve proxy_location: EveryNode
http_options:
host: 0.0.0.0
port: 8000
applications:
- name: ChatBotGroup
route_prefix: /generate
import_path: demo:bot
runtime_env: {
"working_dir": "file:///root/app/app.zip",
"env_vars": {
"HF_HUB_ENABLE_HF_TRANSFER": "1",
}
}
deployments:
- name: ChatBot
user_config:
repo_id: "TheBloke/dolphin-2.5-mixtral-8x7b-GGUF"
model_file: "dolphin-2.5-mixtral-8x7b.Q4_K_M.gguf"
tensor_split: [0.6, 1, 1, 1]
ray_actor_options:
num_gpus: 4.0
num_replicas: 2
- name: ChatClient
route_prefix: /
import_path: demo:app
runtime_env: {
"working_dir": "file:///root/app/app.zip",
"env_vars": {
"CONCURRENCY_LIMIT": "2",
"TITLE": "Chat - Dolphin 2.5 Mixtral 8x7b",
"CHAT_LABEL": "dolphin-2.5-mixtral-8x7b.Q4_K_M.gguf",
}
}
deployments:
- name: ChatIngress
num_replicas: 1Downgrading with |
This didn't work for me, but
This worked. |
abidlabs
changed the title
|
None of the above suggestion are working for me. |
|
I have the same error, deploying I run FastAPI using uvicorn: In from fastapi import FastAPI, Request
import gradio as gr
import requests
import datetime
CUSTOM_PATH = "/gradio"
app = FastAPI()
def greet(name):
return "Hello " + name + "!"
io = gr.Interface(fn=greet, inputs="textbox", outputs="textbox")
gradio_app = gr.routes.App.create_app(io)
app.mount(CUSTOM_PATH, gradio_app)I'm setting the following environment variables in the dockerfile (from I can provide a full minimal example if needed. |
Thanks, this works for me! |
|
@shaojun (or anybody else who faced this issue), if you can provide more details about the proxy you're using and how it's configured, we might be able to provide a solution for this. |
Environment
Issue DescriptionI encountered a export http_proxy=http://<windows-ip>:<port>
export https_proxy=http://<windows-ip>:<port>where and are the IP and port of the proxy software on Windows. Steps to Reproduce Error Message KeyError: 'Event not found in queue. If you are deploying this Gradio app with multiple replicas, please enable stickiness to ensure that all requests from the same user are routed to the same instance.'Temporary Solution |
|
Which reverse proxy library /software are you using? |
|
I'm using clash for windows(CFW), can this help? |
|
Thanks @iwannabewater I think that should be enough for us to repro this. I'll take a look! |
Describe the bug
followed exactly the official tutorial, the web page can show correctly, but if I entered sth in textbox, and click submit, the exception show:
can get to work by downgrade to
4.8.0:Have you searched existing issues? 🔎
Reproduction
Screenshot
No response
Logs
No response
System Info
Severity
Blocking usage of gradio
The text was updated successfully, but these errors were encountered: