Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Select data for benchmarking #151

Closed
Anmol-Srivastava opened this issue Aug 3, 2023 · 1 comment · Fixed by #155
Closed

Select data for benchmarking #151

Anmol-Srivastava opened this issue Aug 3, 2023 · 1 comment · Fixed by #155
Assignees
@Anmol-Srivastava
Labels
benchmarking Related to testing or comparing detectors data Addresses issue with internal datasets nlp Related to development of NLP capabilities
Milestone
Initial NLP Support

Comments

@Anmol-Srivastava
Copy link
Contributor

Task

Select 1+ datasets that can be used as test / example data for NLP-based drift detection methods

Impact

Helps test other tools / any algorithms developed within menelaus
@Anmol-Srivastava Anmol-Srivastava added this to the Initial NLP Support milestone Aug 3, 2023
@Anmol-Srivastava Anmol-Srivastava self-assigned this Aug 3, 2023
@Anmol-Srivastava Anmol-Srivastava added data Addresses issue with internal datasets benchmarking Related to testing or comparing detectors nlp Related to development of NLP capabilities labels Aug 3, 2023
@anmol-srivastava-mitre
Copy link
Contributor

anmol-srivastava-mitre commented Aug 3, 2023 •
edited by Anmol-Srivastava
Loading

  • incorporate wilds datasets as optional dependency
  • attribute appropriately per license
  • add test harness

@Anmol-Srivastava Anmol-Srivastava mentioned this issue Aug 7, 2023
Merged
@Anmol-Srivastava Anmol-Srivastava linked a pull request Aug 7, 2023 that will close this issue
Select wilds datasets for NLP tools #155
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@Anmol-Srivastava Anmol-Srivastava

Labels
benchmarking Related to testing or comparing detectors data Addresses issue with internal datasets nlp Related to development of NLP capabilities
Projects
None yet
Milestone
Initial NLP Support
Development

Successfully merging a pull request may close this issue.

Select wilds datasets for NLP tools mitre/menelaus
2 participants
@Anmol-Srivastava @anmol-srivastava-mitre