Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

no-contrast CTs get bad performance on KiTS model #61

Open
nohalloween opened this issue Apr 27, 2023 · 1 comment
Open

no-contrast CTs get bad performance on KiTS model #61

nohalloween opened this issue Apr 27, 2023 · 1 comment

Comments

@nohalloween
Copy link

hi!recently i have been working on no-contrast CTs(more than 300) kidney segmentation,while 90% of them get very bad performance on KiTS.
it confused me and I have checked the two datasets ,both KiTS and mine ,to ensure they remain highly consistent expect for differences in kidney HU intensity.
I do have some other CTs with contrast (just like the KiTS) and the fact is that when do the inference on kidney filled with medium, KiTS model demonstrats outstanding performance but it fails to segment a whole kidney in no-contrast CTs.
is there any chance that KiTS21/19 model rely on high HU intensity too much to make judgments using contrast,while hardly capturing other features such as position and shape so that when medium disappears the model cannot recognize kidneys?

@neheller
Copy link
Owner

It's always difficult to say what features, exactly, the segmentation model is using the make its predictions, but your results seem to suggest that enhancement is an important feature. This doesn't surprise me too much since the kidneys enhance so conspicuously, especially in the arterial contrast phase.

Of course, in the context of the KiTS21 training set, non-contrast CT scans are "out of distribution" and so it's difficult to reason about expected performance on that population. But one thing that might help is to train on other contrast phases as well, if not non-contrast. The KiTS23 dataset includes cases in the nephrogenic phase, which might force the model to learn through some of the aterial-dependent features its using.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants