You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi,
I have just captured a bug in moe_util.py script. In line 310 of /megatron/core/transformer/moe/moe_utils.py, "prob" should be replaced by "probs".
If not, the code throws the following error while using moe-expert-capacity-factor option:
UnboundLocalError: local variable 'capacity_mask' referenced before assignment
Best,
Malikeh
The text was updated successfully, but these errors were encountered:
Hi,
I have just captured a bug in moe_util.py script. In line 310 of
/megatron/core/transformer/moe/moe_utils.py
, "prob" should be replaced by "probs".If not, the code throws the following error while using
moe-expert-capacity-factor
option:Best,
Malikeh
The text was updated successfully, but these errors were encountered: