-
Notifications
You must be signed in to change notification settings - Fork 111
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Merge pull request #165 from zjysteven/main
Minor fix
- Loading branch information
Showing
3 changed files
with
23 additions
and
5 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -47,3 +47,22 @@ From the repository folder | |
```shell | ||
pre-commit install | ||
``` | ||
|
||
## Contributing to OpenOOD leaderboard | ||
|
||
We welcome new entries submitted to the leaderboard. Please follow the instructions below to submit your results. | ||
|
||
1. Evaluate your model/method with OpenOOD's benchmark and evaluator such that the comparison is fair. | ||
|
||
2. Report your new results by opening an issue. Remember to specify the following information: | ||
|
||
- **`Training`**: The training method of your model, e.g., `CrossEntropy`. | ||
- **`Postprocessor`**: The postprocessor of your model, e.g., `MSP`, `ReAct`, etc. | ||
- **`Near-OOD AUROC`**: The AUROC score of your model on the near-OOD split. | ||
- **`Far-OOD AUROC`**: The AUROC score of your model on the far-OOD split. | ||
- **`ID Accuracy`**: The accuracy of your model on the ID test data. | ||
- **`Outlier Data`**: Whether your model uses the outlier data for training. | ||
- **`Model Arch.`**: The architecture of your base classifier, e.g., `ResNet18`. | ||
- **`Additional Description`**: Any additional description of your model, e.g., `100 epochs`, `torchvision pretrained`, etc. | ||
|
||
3. Ideally, send us a copy of your model checkpoint so that we can verify your results on our end. You can either upload the checkpoint to a cloud storage and share the link in the issue, or send us an email at [[email protected]](mailto:[email protected]). |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters