Table extraction: how to keep the columns empty?

[aborruso]

Hi,
I have this sample PDF sample PDF.

If I try to extract content from it via cli or via python code the column with no values on page 2 is removed, making it impossible to merge the two tables.
Is there no way to output the empty columns as well?

Thank you

[maxmnemonic]

Hello @aborruso I see, yes indeed, we have a post processing step in our table model that removes fully empty columns and rows, as it's not obvious in every case if it's intentionally empty column (depending on table styling). In your case it's clear it's intentional.
Currently there is no direct way to control it from Docling straight, but we can add a parameter for the future version.

Thanks for suggesting this!

[aborruso]

Currently there is no direct way to control it from Docling straight, but we can add a parameter for the future version.

Do I open a feature request? That seems very important to me

[maxmnemonic]

Consider this a request, I will make an issue :)

[aborruso]

Thank you very much!

[maxmnemonic]

Created an issue, we will look into it very soon: #204

[aborruso]

Hi @maxmnemonic When do you plan to implement this? It is just a wish, I don't want to pressure you. Thank you very much

[aborruso]

Hi @maxmnemonic I'm adding here a note related to the same PDF: the last rows at page 1 are not extracted well and an extra row is produced with incorrectly arranged cells (see below).

Is it useful to create a new issue about this?

Thank you

[maxmnemonic]

@aborruso I see, can you please try this option:
TableFormerMode.ACCURATE
as described here: https://ds4sd.github.io/docling/usage/#control-pdf-table-extraction-options

let me know if it helps.

[aborruso]

TableFormerMode.ACCURATE
as described here: ds4sd.github.io/docling/usage#control-pdf-table-extraction-options

I will try it, thank you. Can you make this option available in cli use as well?

[dolfim-ibm]

We have a PR since this morning 😉
#203

@maxmnemonic I tried already and it didn't help.

[aborruso]

@maxmnemonic @dolfim-ibm I have tried with the 2.4 release and it works using accurate. GREAT!!

What I am missing, is the option to choose not to delete empty columns (and rows). Which is the theme of this discussion.
I know there is an issue on this and I am happy about it.

Thank you very much