New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support for loading pretrained weights into networks: #239

Open

PrithivirajDamodaran opened this issue Sep 21, 2022 · 2 comments

PrithivirajDamodaran commented Sep 21, 2022

Is the support for loading pre-trained checkpoints for different VIT architectures from hubs like huggingface something you would consider doing ?

kingkung2016 commented Sep 13, 2023

I am also worried about this. Could you give examples for loading pre-trained checkpoints?

liyiersan commented Nov 22, 2023

I hope this works for you. I provide an example of loading a pre-trained vit-base. Please refer to https://github.com/liyiersan/MSA/blob/22243186133369941bb78bbd93e6e2cd04317f66/models/vit.py#L133-L211.
or you can refer to https://github.com/Sebastian-X/vit-pytorch-with-pretrained-weights.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment