Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

does/can hivemind work with deepspeed ZeRO-3 Offload? [Feature Request] #583

Open
sirus20x6 opened this issue Aug 15, 2023 · 0 comments
Open

does/can hivemind work with deepspeed ZeRO-3 Offload? [Feature Request] #583

sirus20x6 opened this issue Aug 15, 2023 · 0 comments
Labels
enhancement New feature or request help wanted Extra attention is needed

Comments

@sirus20x6
Copy link

I'm curious if hivemind can be made to use deepspeed ZeRO-3 Offload on clients for training
@sirus20x6 sirus20x6 added enhancement New feature or request help wanted Extra attention is needed labels Aug 15, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request help wanted Extra attention is needed
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@sirus20x6