Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How about calculating TEDS? #13

Open
PC-god opened this issue Mar 5, 2021 · 10 comments
Open

How about calculating TEDS? #13

PC-god opened this issue Mar 5, 2021 · 10 comments

Comments

@PC-god
Copy link

PC-god commented Mar 5, 2021

Thanks your project.
According to lasted commit, I can calculate xml outputs. When I want to calculate TEDS metric, I don't find the corresponding function.
If you write corresponding function, please indicate its location.
In the end, thanks very much.

@wangwen-whu
Copy link

Hi, I can calculate xml outputs, too. And I have TEDS code, do you need? I can share with you. But I want to ask you the results you get on UNLV test data are like this?
image
image

this jpg is in the /TabStructNet-master/trained_model/tab/result_jpg/AR_1024.jpg and AR_1025.jpg, do you get the same results with me? I am wonder I get something wrong

@sachinraja13
Copy link
Owner

Can you please try to increase the DETECTION_NMS_THRESHOLD value to 0.5 or higher and test again?

@wangwen-whu
Copy link

Can you please try to increase the DETECTION_NMS_THRESHOLD value to 0.5 or higher and test again?

Thank you very much! I change the DETECTION_NMS_THRESHOLD value to 0.5 then I get all the bboxs ! This is really help me a lot! May I ask you another question? I try to use two GPUS to finetune the model on my own dataset, change the GPU_COUNT=2 in tabnet.py, however i got this error seems like batch_size couldn't match the code. But if i change Image_PER_GPU=2 (or4) that is ok, could you please to help me use more than one GPU?
image

@sachinraja13
Copy link
Owner

Hi, I will try and figure this out and will update you.

@wangwen-whu
Copy link

Thank you very much! Looking forward to your reply~~

@yihaoding
Copy link

@PC-god @wangwen-whu Hi, is there any comments talking about how to evalutate the output xml files? Thanks for your help.

@anishdulal
Copy link

Hi @wangwen-whu, can you please share the code to generate the TEDS metric?

@wangwen-whu
Copy link

Hi,the TEDS code is mentioned here https://github.com/ibm-aur-nlp/PubTabNet/tree/master/src
it need html style to be the input, next month, I will upload a transform code in my work: WTW dataset . You can use it if you need it too.

@anishdulal
Copy link

@wangwen-whu, thank you very much!

@anishdulal
Copy link

Hi @wangwen-whu , were you able to solve the issue with training on two GPUs? My GPU is just 8GB and it won't fit two images so I can't make IMAGE_PER_GPU=2 but I have access to multiple GPUs of 8GB. I am now stucked at the problem you mentioned earlier.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants