Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add tests for De-Identification #954

Open
dcecchini opened this issue Jan 4, 2024 · 1 comment
Open

Add tests for De-Identification #954

dcecchini opened this issue Jan 4, 2024 · 1 comment
Assignees
Labels
⏭️ Next Release Issues or Request for the next release

Comments

@dcecchini
Copy link
Contributor

dcecchini commented Jan 4, 2024

We already have tests for NER models, but we should add a category for De-Identification so that we can test models for this specific capability.

We could extend it to test on clinical relevant de-identification tasks such as being compliant with HIPAA, etc.

@chakravarthik27
Copy link
Collaborator

De-Identification examples

Category Test Type Original Test Case Expected Actual Pass
DeIdentification Simple Masking Patient John Doe was admitted on 01/01/2024. Mask names and dates PATIENT [MASK] was admitted on [MASK]. PATIENT [MASK] was admitted on [DATE]. True
DeIdentification HIPAA Compliance The patient's address is 123 Main St, Anytown. Mask address according to HIPAA The patient's address is [MASK] [MASK] [MASK]. The patient's address is [MASK] [MASK] CA. False
DeIdentification Redaction vs. Replacement The patient suffered from depression. Redact mental health conditions The patient suffered from [MENTAL_CONDITION]. The patient suffered from [REDACTED]. True

@ArshaanNazir ArshaanNazir added the ⏭️ Next Release Issues or Request for the next release label Feb 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
⏭️ Next Release Issues or Request for the next release
Projects
None yet
Development

No branches or pull requests

3 participants