Issues: open-compass/VLMEvalKit
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
[Request]Consider integrating MMT-Bench and CONTEXTUAL?
#196
opened May 10, 2024 by
iamlockelightning
The code for evaluating open question of MMMU is completely wrong
#110
opened Mar 11, 2024 by
xwwu2015
There is a long gap between the validation accuracy of the dataset of vlmevalkit and the model paper
#94
opened Feb 23, 2024 by
YongLD
How are models that use in-context examples handled?
Feature Request
#90
opened Feb 7, 2024 by
sachit-menon
Does vlmeval support multi card inference and batch size > 1?
Feature Request
#32
opened Dec 28, 2023 by
John-Ge
ProTip!
no:milestone will show everything without a milestone.