Validation max_failures is turned on by default, against documentation.

[jayckaiser]

Reference validation is not actually optional in Lightbeam. The default value is hard-coded to 10, despite the documentation stating otherwise.

validate:
  references:
    max_failures: 10 # stop testing after X failed payloads ("fail fast")

This is optional; if absent, references in every payload are checked, no matter how many fail.