INFO: Found overflow. Skip step

[stephencurry-web]

I trained Llama2-7B chat on the Alpaca dataset, and when I set the batch size to 2 or 4, INFO: Found overflow appeared at each step of the entire training process Skip step, And the gradient is nan, which is normal when I set the batch size to 1. May I ask what the reason is？