Do you consider trying Alpha-DINOv2?

[grainseed]

DINOv2 seems powerful in some applications like CLIP, maybe a similar Alpha-DINOv2 is very useful too

[SunzeY]

Hi, I'm not consider doing this now. This is an interesting question. I believe this may need more delicate design of augmentations on sample to generate negative pairs for image only contrastive learning.