You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
According to the code, it seemed that you used the lora method.
This, in my opinion, will destroy the sparsity you have made in the original model after merging the lora weights to the model weights.
could you explain this?
Thanks
Shawn
The text was updated successfully, but these errors were encountered:
Hi,
Great work first!
I am confused with the model tuning part.
According to the code, it seemed that you used the lora method.
This, in my opinion, will destroy the sparsity you have made in the original model after merging the lora weights to the model weights.
could you explain this?
Thanks
Shawn
The text was updated successfully, but these errors were encountered: