New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

cur_input_embeds = torch.cat([cur_input_embeds_1, cur_image_features[0:0], cur_input_embeds_2], dim=0),其中cur_image_features[0:0]表示这是一个没有维度的向量，图像的特征并没有真正加进去 #193

Open

hangzeli05 opened this issue Dec 11, 2023 · 1 comment

hangzeli05 commented Dec 11, 2023

mPLUG-Owl2中的代码错误

vateye commented Dec 18, 2023

No, it is for compatible with deepspeed zero3 during training on text samples. For multi-modal input, this would not encounter.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment