What could be the reason that the model weights are not updating while finetuning?

[DDXDaniel]

I used this command "python run.py with data_root=/data2/dsets/dataset num_gpus=8 num_nodes=1 task_finetune_irtr_f30k_randaug per_gpu_batchsize=4 load_path="weights/vilt_200k_mlm_itm.ckpt"" to fine-tuned VILT on Flickr30k dataset, but I noticed that the model weights are not updating. Below are the VILT partial weight parameters output at each step. What could be the possible reasons causing this issue?

[DDXDaniel]

@dandelin I would be very grateful if you could help me with this issue.

[dahalbishu]

@DDXDaniel did you solve this problem? i m facing same problem