Skip to content

Commit

Permalink
humbug
Browse files Browse the repository at this point in the history
  • Loading branch information
hinthornw committed Jul 16, 2024
1 parent 4556010 commit f701884
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions docs/evaluation/faq/unit-testing.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -195,8 +195,8 @@ The following metrics are available off-the-shelf:
| -------------------- | ----------------------------------------------------------- | --------------------------------------------------------------------------------------------------------------------- |
| `pass` | Binary pass/fail score, 1 for pass, 0 for fail | `assert False` # Fails |
| `expectation` | Binary expectation score, 1 if expectation is met, 0 if not | `expect(prediction).against(lambda x: re.search(r"\b[a-f\d]{8}-[a-f\d]{4}-[a-f\d]{4}-[a-f\d]{4}-[a-f\d]{12}\b", x)` ) |
| `embedding_distance` | Cosine distance between two embeddings | expect.embedding_distance(prediction=prediction, reference=expectation) |
| `edit_distance` | Edit distance between two strings | expect.edit_distance(prediction=prediction, reference=expectation) |
| `embedding_distance` | Cosine distance between two embeddings | expect.embedding_distance(prediction=prediction, reference=expectation) |
| `edit_distance` | Edit distance between two strings | expect.edit_distance(prediction=prediction, reference=expectation) |

You can also log any arbitrary feeback within a unit test manually using the `client`.

Expand Down

0 comments on commit f701884

Please sign in to comment.