Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Present a bit more information about the differences between pipelines #2551

Open
paul-butcher opened this issue Feb 7, 2024 · 0 comments
Open

Comments

@paul-butcher
Copy link
Contributor

diff_tool presents a pass/fail/warning view of the differences between two versions of the API. However, when the differences are significant, we are left with a "Well, what now?" feeling. In #2549, there were 2400 missing records, but no simple way to get a sample of what is missing.

Similarly, when the differences are insignificant (e.g. there are two Botany records that occasionally swap places in the search results or there are less than 10 [missing|extra] documents), that still takes a degree of investigation. One has to open a browser tab for each API, copy the path onto each and eyeball them. This information then vanishes like tears in the rain, and is not associated with the deployment build.

It would be nice to have some more data presented either as part of diff tool, or at least for there to be a more convenient way to discover it.

See also: #2550

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant