Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] ollama发布的模型如何评估支持 #1095

Open
1 task
18600709862 opened this issue Apr 26, 2024 · 1 comment
Open
1 task

[Feature] ollama发布的模型如何评估支持 #1095

18600709862 opened this issue Apr 26, 2024 · 1 comment
Assignees

Comments

@18600709862
Copy link

描述该功能

ollama直接发布本地模型非常方便,如何对这种api进行评估,是否可以给一个例子。

是否希望自己实现该功能?

  • 我希望自己来实现这一功能,并向 OpenCompass 贡献代码!
@bittersweet1999
Copy link
Collaborator

API模型评估在opencompass/opencompass/models里有较多例子,如https://github.com/open-compass/opencompass/blob/main/opencompass/models/bytedance_api.py
你可以尝试在里面实现一个新的类并写好generate函数,从而可以在外面的config中调用这个新的API模型class

@DseidLi DseidLi changed the title ollama发布的模型如何评估支持[Feature] [Feature] ollama发布的模型如何评估支持 Apr 28, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants