Replies: 1 comment
-
python3 -m lmdeploy.serve.turbomind.deploy llama2 /path/to/llama2-7b --dst-path /path/to/workspace/of/llama2-7b
python3 -m lmdeploy.serve.turbomind.deploy llama2 /path/to/llama2-13b --dst-path /path/to/workspace/of/llama2-13b |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I want to deploy llama2-7b and llama2-13b at the same time.
after I run the command:
I have a dir named workspace, but how can I have another workspace for llama2-13b.
Do I need to find a different path to save another workspace and change the docker name of service_docker_up.sh?
Beta Was this translation helpful? Give feedback.
All reactions