Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

kagentlms_baichuan2_13b_mat无法用fastchat部署 #44

Open
FanWan opened this issue Mar 11, 2024 · 0 comments
Open

kagentlms_baichuan2_13b_mat无法用fastchat部署 #44

FanWan opened this issue Mar 11, 2024 · 0 comments

Comments

@FanWan
Copy link

FanWan commented Mar 11, 2024

hello,我下载了kagentlms_baichuan2_13b_mat模型,但是没办法通过fastchat部署,,以下是报错:

2024-03-11 22:02:00 | INFO | model_worker | args: Namespace(host='192.168.80.2', port=9015, worker_address='http://192.168.80.2:9015', controller_address='http://192.168.80.2:9083', model_path='/home/ssd1/record/llm_models/kagentlms_baichuan2_13b_mat/', revision='main', device='cuda', gpus=None, num_gpus=1, max_gpu_memory=None, dtype=None, load_8bit=False, cpu_offloading=False, gptq_ckpt=None, gptq_wbits=16, gptq_groupsize=-1, gptq_act_order=False, awq_ckpt=None, awq_wbits=16, awq_groupsize=-1, model_names=['kwai_agent_baichuan'], conv_template=None, embed_in_truncate=False, limit_worker_concurrency=5, stream_interval=2, no_register=False, seed=None)
2024-03-11 22:02:00 | INFO | model_worker | Loading the model ['kwai_agent_baichuan'] on worker a59d1063 ...
Could not locate the modeling_baichuan.py inside kwaikeg/kagentlms_baichuan2_13b_mat.
2024-03-11 22:02:03 | ERROR | stderr | Traceback (most recent call last):
2024-03-11 22:02:03 | ERROR | stderr | File "/root/anaconda3/envs/fschat2/lib/python3.10/site-packages/urllib3/connection.py", line 203, in _new_conn
2024-03-11 22:02:03 | ERROR | stderr | sock = connection.create_connection(
2024-03-11 22:02:03 | ERROR | stderr | File "/root/anaconda3/envs/fschat2/lib/python3.10/site-packages/urllib3/util/connection.py", line 85, in create_connection
2024-03-11 22:02:03 | ERROR | stderr | raise err
2024-03-11 22:02:03 | ERROR | stderr | File "/root/anaconda3/envs/fschat2/lib/python3.10/site-packages/urllib3/util/connection.py", line 73, in create_connection
2024-03-11 22:02:03 | ERROR | stderr | sock.connect(sa)
2024-03-11 22:02:03 | ERROR | stderr | OSError: [Errno 101] Network is unreachable
2024-03-11 22:02:03 | ERROR | stderr |
2024-03-11 22:02:03 | ERROR | stderr | The above exception was the direct cause of the following exception:
2024-03-11 22:02:03 | ERROR | stderr |
2024-03-11 22:02:03 | ERROR | stderr | Traceback (most recent call last):
2024-03-11 22:02:03 | ERROR | stderr | File "/root/anaconda3/envs/fschat2/lib/python3.10/site-packages/urllib3/connectionpool.py", line 790, in urlopen
2024-03-11 22:02:03 | ERROR | stderr | response = self._make_request(
2024-03-11 22:02:03 | ERROR | stderr | File "/root/anaconda3/envs/fschat2/lib/python3.10/site-packages/urllib3/connectionpool.py", line 491, in _make_request
2024-03-11 22:02:03 | ERROR | stderr | raise new_e
2024-03-11 22:02:03 | ERROR | stderr | File "/root/anaconda3/envs/fschat2/lib/python3.10/site-packages/urllib3/connectionpool.py", line 467, in _make_request
2024-03-11 22:02:03 | ERROR | stderr | self._validate_conn(conn)
2024-03-11 22:02:03 | ERROR | stderr | File "/root/anaconda3/envs/fschat2/lib/python3.10/site-packages/urllib3/connectionpool.py", line 1092, in _validate_conn
2024-03-11 22:02:03 | ERROR | stderr | conn.connect()
2024-03-11 22:02:03 | ERROR | stderr | File "/root/anaconda3/envs/fschat2/lib/python3.10/site-packages/urllib3/connection.py", line 611, in connect
2024-03-11 22:02:03 | ERROR | stderr | self.sock = sock = self._new_conn()
2024-03-11 22:02:03 | ERROR | stderr | File "/root/anaconda3/envs/fschat2/lib/python3.10/site-packages/urllib3/connection.py", line 218, in _new_conn
2024-03-11 22:02:03 | ERROR | stderr | raise NewConnectionError(
2024-03-11 22:02:03 | ERROR | stderr | urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPSConnection object at 0x7f9aaccac430>: Failed to establish a new connection: [Errno 101] Network is unreachable

Could not locate the modeling_baichuan.py inside kwaikeg/kagentlms_baichuan2_13b_mat. 我已经在下好模型文件了啊

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant