Qwen/eval中的评测CEval和CMMLU，开大推理的batchsize评测指标会显著降低

[ntz2000]

Qwen/eval中的评测脚本CEval和CMMLU，开大推理的batchsize能够加快推理速度，但是评测指标会显著降低，只有开1才能得到最高的指标，这是为啥？

[github-actions]

This issue has been automatically marked as inactive due to lack of recent activity. Should you believe it remains unresolved and warrants attention, kindly leave a comment on this thread.
此问题由于长期未有新进展而被系统自动标记为不活跃。如果您认为它仍有待解决，请在此帖下方留言以补充信息。