Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

convert agora data and visual smpl is wrong? #124

Open
Gzzgz opened this issue Mar 4, 2022 · 13 comments · Fixed by #143
Open

convert agora data and visual smpl is wrong? #124

Gzzgz opened this issue Mar 4, 2022 · 13 comments · Fixed by #143
Assignees

Comments

@Gzzgz
Copy link

Gzzgz commented Mar 4, 2022

I convert agora data , the result is like this:
图片
and I found ori data has 'Cam' folder and you not used it.

@Gzzgz
Copy link
Author

Gzzgz commented Mar 4, 2022

the same as surreal dataset

@Gzzgz
Copy link
Author

Gzzgz commented Mar 5, 2022

Maybe surreal datdaset has some errors.

@pangyyyyy pangyyyyy self-assigned this Mar 6, 2022
@pangyyyyy
Copy link
Collaborator

pangyyyyy commented Mar 7, 2022

@Gzzgz Thanks for raising the issue!

For surreal, I found that some of the ground-truth were noisy/ wrong when I visualised them. For the issue you raised here (#121), there is a problem of left-right of flipping 3d keypoints and smpl poses that has been confirmed by the author, which I will push up the fix soon. I also realised that the global orientation is wrong for some samples but I have yet to obtain a reply from the author for this.

For agora, I will take a look at it soon.

@Gzzgz
Copy link
Author

Gzzgz commented Mar 7, 2022

@pangyyyyy OK, THX.

@Gzzgz
Copy link
Author

Gzzgz commented Mar 25, 2022

@pangyyyyy
Copy link
Collaborator

pangyyyyy commented Mar 30, 2022

Hi @Gzzgz,I have pushed up the fix for AGORA's global orientation in PR #143. I've made some visualisations and the smpl poses looks correct now.

frame_000005(1)
frame_000008(1)
frame_000001(1)

For SURREAL, I have added the left-right flipping of 3d keypoints and smpl poses - a problem for the issue you raised here (#121) that has been confirmed by the author. However, I have yet to obtain any reply from SURREAL's authors regarding the incorrect global orientation.

@YongtaoGe
Copy link
Contributor

Hi, @pangyyyyy Could you give me an example visualization script for the converted agora dataset? Thanks!

@caizhongang
Copy link
Collaborator

Hi, @pangyyyyy Could you give me an example visualization script for the converted agora dataset? Thanks!

We will have add a data visualizer tool for HumanData format soon ;)

@Gzzgz
Copy link
Author

Gzzgz commented Apr 21, 2022

OK , But I maybe found it has some errors . in training processing, the kpt3d-loss is bigger than not use it. And I vis just look like this:[some images are ok]
图片
图片
图片

And I checkout your codes that like agora dataset codes. I maybe think the agora-dataset code is wrong.

@Gzzgz
Copy link
Author

Gzzgz commented Apr 22, 2022

I think this code should be like :
图片

But I found realy it has a little angle error in some images.like it:
图片

@Gzzgz
Copy link
Author

Gzzgz commented Apr 24, 2022

@caizhongang can you doing it with SMPL or SMPLX in cam?

@pangyyyyy
Copy link
Collaborator

Hello @Gzzgz, thanks for your inputs, the keypoints3d problem and incorrect global orientation problem is fixed in #202.

I've visualised more images of the converted annotations but they look alright to me. Do you mind providing an example of the annotation id for the problematic visualisations?

@John-Yao
Copy link

@Gzzgz @caizhongang
Could you give me an example visualization script for the converted agora dataset? Thanks!
The official visualization tools is too complex to visual single image results

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

5 participants