New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Issue with 70B instruct #157
Comments
I have the same issue. |
I have the same issue |
@subramen same issue. what more information would you need ? cause the current state for me is:
and getting the above error. i also changed the backend from nccl to gloo to account for the warnings that were appearing, maybe that has something to do with it ? |
How many GPUs are you using? the 70B model will need 8GPUs to run from this repo. If you have less than 8 GPUs, please use the model from HF |
my solution for reference: |
machine Standard NC96ads A100 v4 (96 vcpus, 880 GiB memory)
The text was updated successfully, but these errors were encountered: