New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature] 是否可以对arc-e和arc-c的base模型评估增加25-shot with choice #1082

Open

1 task

siftxxx opened this issue Apr 24, 2024 · 0 comments

Assignees

siftxxx commented Apr 24, 2024

描述该功能

with choice和wo choice差几十个点，希望可以对齐llama3中的评估方式

https://github.com/meta-llama/llama3/blob/main/eval_details.md

是否希望自己实现该功能？

我希望自己来实现这一功能，并向 OpenCompass 贡献代码！

mm-assistant bot assigned liushz

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment