We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
python3 -m flexgen.flex_opt --model facebook/opt-30b --percent 0 100 100 0 100 0 --offload-dir /scratch/bcjw/ding3/flexgen_offload_dir --path /scratch/bcjw/ding3/opt_weights <run_flexgen>: args.model: facebook/opt-30b model size: 55.803 GB, cache size: 2.789 GB, hidden size (prefill): 0.029 GB init weight... Killed
I use this script. it shows killed and has no output.
The text was updated successfully, but these errors were encountered:
run on 2xA100 node, pytorch 2.2.1 @Ying1123 @BinhangYuan
Sorry, something went wrong.
it seems stuck at self.init_weight(j) where j = 68 for opt-30b
self.init_weight(j)
No branches or pull requests
I use this script. it shows killed and has no output.
The text was updated successfully, but these errors were encountered: