Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

VQA test in EQA baseline implement #1825

Open
knightwzh opened this issue Feb 29, 2024 · 0 comments
Open

VQA test in EQA baseline implement #1825

knightwzh opened this issue Feb 29, 2024 · 0 comments

Comments

@knightwzh
Copy link

Habitat-Lab and Habitat-Sim versions

Habitat-Lab: master

Habitat-Sim: master

❓ Questions and Help

I notice that both in the article for EQA implement (Embodied Question Answering, (Das et al. CVPR 2018)) and in the dataset used for this task (Embodied Question Answering in Photorealistic Environments with Point Cloud Perception, (Wijmans et al. CVPR 2018)). The test for VQA test seems based on the observation from navigation module, so there are results related how many actions away from the question target.
However, in the provided implementation it seems like the VQA part is independent from the navigation part. My question is: Where is the "last 5 frames" in VQA part come from? Is it the shortest path or the HumanNav? And how can I use the observation from navigation as the input for the VQA part.
Thank you for the help.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant