Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Demo always predict 2 hands #9

Open
RoiPapo opened this issue Jun 27, 2023 · 7 comments
Open

Demo always predict 2 hands #9

RoiPapo opened this issue Jun 27, 2023 · 7 comments

Comments

@RoiPapo
Copy link

RoiPapo commented Jun 27, 2023

Hi, even on InterHand2.6M set that the model were trained on, when I try to visualize the prediction on single hand images using the demo.py ,
it shows both hands, I tried to debug and find out a number of hands evaluation but I couldn't it looks like the 2 hands case is hard coded on the demo code
Capture0_0010_thumbtuckrigid_cam400031_image3881
(3d color was changed but nothing more)
thank you :)

@mks0601
Copy link
Collaborator

mks0601 commented Jun 27, 2023

Hi,

Sorry about this. As you mentioned, the demo code is hard-coded for the two-hand cases.
One possible way to handle the single-hand case is checking confidence of hand boxes from the hand detection network.
Let me add that soon

@wefwwef4
Copy link

Hi,

Sorry about this. As you mentioned, the demo code is hard-coded for the two-hand cases. One possible way to handle the single-hand case is checking confidence of hand boxes from the hand detection network. Let me add that soon

hi, I still can't find where to cahnge confidence of hand boxes

@mks0601
Copy link
Collaborator

mks0601 commented Jul 27, 2023

Hi, sorry for late.
You can use bbox confidence in here

hand_bbox_conf = float(out[h[0] + 'hand_bbox_conf'].cpu().numpy()[0]) # bbox confidence

@wefwwef4
Copy link

HI,Sometimes it is obvious that there is only the right hand, but the confidence of the left-handed bbx will suddenly increase. Is there a standard for judging?

@mks0601
Copy link
Collaborator

mks0601 commented Jul 31, 2023

sorry that could be wrong predictions of the model.

@gmindflow
Copy link

Then would it be correct to understand that the DetectNet isn't clearly robust enough to distinguish "one hand" and "two hands extremely occluding another"?

Or is this only a problem with the demo code itself?

@mks0601
Copy link
Collaborator

mks0601 commented Aug 24, 2023

I think your're right. There should be some room to improve DetectNet.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants