We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
fastchat version 0.2.36
First, start the services:
python3 -m fastchat.serve.controller --port 21002 --host 0.0.0.0 python3 -m fastchat.serve.model_worker --port 21003 --model-names bge-m3 --model-path /root/proj/models/bge-m3 --device cpu --controller-address http://0.0.0.0:21002 --host 0.0.0.0 python3 -m fastchat.serve.openai_api_server --controller-address http://0.0.0.0:21002 --port 8001 --host 0.0.0.0
python3 -m fastchat.serve.controller --port 21002 --host 0.0.0.0
python3 -m fastchat.serve.model_worker --port 21003 --model-names bge-m3 --model-path /root/proj/models/bge-m3 --device cpu --controller-address http://0.0.0.0:21002 --host 0.0.0.0
python3 -m fastchat.serve.openai_api_server --controller-address http://0.0.0.0:21002 --port 8001 --host 0.0.0.0
Then, post requests to the 8001 port:
import requests url = "http://10.99.106.214:8001/v1/embeddings" headers = { "Content-Type": "application/json" } data = { "model": "bge-m3", "input": "Hello world!" } response = requests.post(url, headers=headers, json=data) 查看响应内容 print(response.text)
import requests
url = "http://10.99.106.214:8001/v1/embeddings" headers = { "Content-Type": "application/json" } data = { "model": "bge-m3", "input": "Hello world!" }
response = requests.post(url, headers=headers, json=data)
print(response.text)
and get the response: {"object":"error","message":"Not Found","code":50001}
{"object":"error","message":"Not Found","code":50001}
The text was updated successfully, but these errors were encountered:
@chillizex , this error is from fastchat, so you can open a issue in fastcaht repo. We're sorry that we cannot address this issue.
Sorry, something went wrong.
Thank you, btw, do you have some recommand deploy method that offers openai compatible api?
No branches or pull requests
fastchat version 0.2.36
First, start the services:
python3 -m fastchat.serve.controller --port 21002 --host 0.0.0.0
python3 -m fastchat.serve.model_worker --port 21003 --model-names bge-m3 --model-path /root/proj/models/bge-m3 --device cpu --controller-address http://0.0.0.0:21002 --host 0.0.0.0
python3 -m fastchat.serve.openai_api_server --controller-address http://0.0.0.0:21002 --port 8001 --host 0.0.0.0
Then, post requests to the 8001 port:
and get the response:
{"object":"error","message":"Not Found","code":50001}
The text was updated successfully, but these errors were encountered: