Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

No finger motion in the dataset #76

Open
sohananisetty opened this issue Apr 7, 2024 · 1 comment
Open

No finger motion in the dataset #76

sohananisetty opened this issue Apr 7, 2024 · 1 comment

Comments

@sohananisetty
Copy link

sohananisetty commented Apr 7, 2024

The paper claimed to have finger level motion in the dataset but on rendering the humanml and idea400 datasets there are no finger movements. This can be seen in your DeepDataSpace repo as well. For example in your paper, you showed that you had finger level motion in the piano playing motion (humanml/008422) but there is only wrist movement. Similarly for idea400/subset_0056/Walking_And_Snapping_At_The_Same_Time there is no snapping motion and the hand stays in the the same position throughout. Another example is humanml/006820 (a person appears to be warming up their shoulders and arms, then scans the horizon and sees something while pointing to it) there is no pointing motion of the fingers. The index finger should be extended, but again the hand is in the default pose throughout.

Idea400 example:

Walking_And_Snapping_At_The_Same_Time.mp4

humanml/006820
006820

@linjing7
Copy link
Collaborator

linjing7 commented Apr 8, 2024

Hi, the motions of HumanML3D come from AMASS, which do not have hand movements. We only perform facial expression augmentation for them. As for IDEA400, some of the motions are over-smoothed and thus do not have significant hand finger movements. We will provide an improved version of IDEA400 this week.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants