Don't evaluate only overlapping entities #7522
Joozty
started this conversation in
New Features & Project Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I can see that EntityLinker evaluates only overlapping entities. I think it should also take into account an entity that is wrongly predicted within the gold data entity and count it as false negative (:man_shrugging:)
Example (it's kind of dummy but I hope you will see my point):
Gold data:
I watched a movie called blue car
Prediction:
I watched a movie called blue car. (wrong prediction and it's not taken into account in evaluation)
Beta Was this translation helpful? Give feedback.
All reactions