The actor is dead because its worker process has died. Worker exit type: SYSTEM_ERROR Worker exit detail: Worker unexpectedly exits with a connection error code 2. End of file. There are some potential root causes. (1) The process is killed by SIGKILL by OOM killer due to high memory usage. (2) ray stop --force is called. (3) The worker is crashed unexpectedly due to SIGSEGV or other unexpected errors.

[insistence-essenn]

Note that the issue tracker is NOT the place for general support.
Unable to solve this issue as I am using Distributed-compose.yml

[insistence-essenn]

@frostyplanet @qinxuye @bufferoverflow Any help?

[frostyplanet]

I've encounter the same problem, do not have any clue for now.
What's your enviroment and related package version? (vllm, pytorch, ray, nvidia-drivers, cuda ).
vllm will print error into stdout （but do not log to xinference.log). Could you look for error on the screen output (or docker logs) before the exception ? Is there anything simular to this :