Gradio mounted with fastapi via https in nginx returns wrong path

[aka7774]

Describe the bug

I use https connection and BASIC authentication to securely so many ai apps.

https://fastapi.example.com:18000/gradio
is accessed by the nginx proxy to
http://127.0.0.1:8000/gradio
is called.

http://127.0.0.1:8000/
is fastapi and gradio is mounted on /gradio.

For example, a connection that should access /gradio/info becomes /info and returns a 404 error.

Have you searched existing issues? 🔎

• I have searched and found no existing issues

Reproduction

nginx.conf

server {
  server_name fastapi.example.com;
  listen 18000 ssl;

  location / {
        proxy_pass http://127.0.0.1:8000/;
        proxy_buffering off;
        proxy_redirect off;
        proxy_http_version 1.1;
        proxy_set_header Upgrade $http_upgrade;
        proxy_set_header Connection "upgrade";
        proxy_set_header Host 'fastapi.example.com:18000';
        proxy_set_header X-Forwarded-Host 'fastapi.example.com:18000';
        proxy_set_header X-Forwarded-Proto $scheme;

        auth_basic "Basic Authentication";
        auth_basic_user_file "/etc/nginx/conf.d/.htpasswd";
  }
}

main.py

import gradio as gr
from app import demo
app = FastAPI()
...
gr.mount_gradio_app(app, demo, path="/gradio")

app.py

import gradio as gr
with gr.Blocks() as demo:
...

if __name__ == '__main__':
    demo.launch()

Temporary workaround

  location = /info {
    rewrite ^ /gradio/info;
  }
  location = /theme.css {
    rewrite ^ /gradio/theme.css;
  }
  location /assets/ {
    rewrite (.*) /gradio$1;
  }
  location /heartbeat/ {
    rewrite (.*) /gradio$1;
  }
  location /queue/ {
    rewrite (.*) /gradio$1;
  }

Screenshot

Logs

No response

System Info

gradio==4.27.0
fastapi==0.110.2
uvicorn==0.29.0

nginx version: nginx/1.24.0
built by gcc 11.2.0 (Ubuntu 11.2.0-19ubuntu1)
built with OpenSSL 3.0.2 15 Mar 2022

Severity

I can work around it

[abidlabs]

Will take a look! Thanks for providing the detailed repro

[insistence]

Similar issue, after setting root_path to uvicorn, mounting the gradio app in fastapi shows 404 error. The same error still occurs when the front-end uses the Vite proxy.

from fastapi import FastAPI
import gradio as gr
import uvicorn


app = FastAPI()


def greet(name):
    return "Hello " + name + "!"


gradio_app = gr.Interface(fn=greet, inputs="text", outputs="text")

gr.mount_gradio_app(app, gradio_app, path="/gradio")


if __name__ == "__main__":
    uvicorn.run('app:app', host="0.0.0.0", port=8000, root_path='/dev-api')

I think this issue seems to be related to the bug mentioned in this PR(tiangolo/fastapi#11160).