diff --git a/docs/custom-eval.md b/docs/custom-eval.md index 9e61fb647c..66e6864436 100644 --- a/docs/custom-eval.md +++ b/docs/custom-eval.md @@ -1,6 +1,6 @@ # How to add a custom eval -**Important: Please note that we are currently not accepting Evals with custom code!** While we ask you to not submit such evals at the moment, you can still submit modelgraded evals with custom modelgraded YAML files. +**Important: Please note that we are currently not accepting Evals with custom code!** While we ask you to not submit such evals at the moment, you can still submit modelgraded evals with custom model graded YAML files. This tutorial will walk you through a simple example of writing and adding a custom eval. The example eval will test the model's ability to do basic arithmetic. We will assume that you have followed the setup instructions in the [README](../README.md) and gone through the other docs for how to run and build evals.