Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: docker support #58

Open
wants to merge 5 commits into
base: main
Choose a base branch
from
Open

feat: docker support #58

wants to merge 5 commits into from

Conversation

soulteary
Copy link

@soulteary soulteary commented Mar 25, 2023

Related documents and introductions will be added later. :D

Guide & Blog: https://zhuanlan.zhihu.com/p/616986651

@soulteary soulteary mentioned this pull request Mar 25, 2023
@tensiondriven
Copy link

This is great - I am attempting to stand up docker-ChatRWKV.git. I have a request:

Add ability to use local model path

I have several RWKV models already downloaded, and I want to use them with the docker container. My local VM has limited disk space, and my internet connection is slow.

Adding ability to use local model from a file path would make the docker image more useful to people like me

I will attempt to hack the Dockerfile, but it would be great if this was an option. I think it would let a lot more people see RWKV.

@yhyu13
Copy link

yhyu13 commented May 3, 2023

@tensiondriven

Correct me if I am wrong, I don't think docker mount point support symbolic link, so you would need to mount the actual model path.

@tensiondriven
Copy link

I think you are right. Thank you, I'll give it a try.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants