Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

question about how rpc works in the hivemind package #605

Open
drimeF0 opened this issue Feb 15, 2024 · 0 comments
Open

question about how rpc works in the hivemind package #605

drimeF0 opened this issue Feb 15, 2024 · 0 comments

Comments

@drimeF0
Copy link

drimeF0 commented Feb 15, 2024

Hello, I am currently using hivemind for my project to distribute MoE models with huggingface transformers to peer-to-peer network participants for their inference and training. At the moment I'm stuck because I don't quite understand how rpc calls work in the hivemind package. I wanted to implement the ability to download the state_dict of each expert from network participants, but I still didn’t quite understand how to do it correctly. I assume that in "moe.server.connection_handler.ConnectionHandler" you need to create a method that starts with rpc_, and then use stub in "moe.client.expert"?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant