Replies: 1 comment 2 replies
-
Hi kratorado, I recommend running your command with the python3 run.py configs/api_examples/eval_api_mymodel.py --debug After running with debugging enabled, check the detailed logs from console to better understand the errors. Best of luck! |
Beta Was this translation helpful? Give feedback.
2 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I deployed a vllm backed openai api server to serve my tuned model. And I want to evaluate the performance using opencompass.
my config file:
After execute the command
python3 run.py configs/api_examples/eval_api_mymodel.py
, I got many ERROR logs from console.# many lines like 04/27 20:44:22 - OpenCompass - ERROR - /data/homedir/work/opencompass/opencompass/opencompass/runners/local_api.py - launch - 131 - task OpenICLInfer[mymodel/cmmlu-virology] fail, see outputs/api_myqwen/20240427_204403/logs/infer/mymodel/cmmlu-virology.out
And what's in that .out files is:
the server did not receive any request.
Beta Was this translation helpful? Give feedback.
All reactions