Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improved Coverage Testing #122

Open
ncough opened this issue Jan 17, 2025 · 0 comments
Open

Improved Coverage Testing #122

ncough opened this issue Jan 17, 2025 · 0 comments

Comments

@ncough
Copy link
Collaborator

ncough commented Jan 17, 2025

A number of bugs have slipped past the coverage tester as we start to worry about the tail end of architecture behaviours. It would be nice if the coverage tester could be extended, such that:

  • It's easier to configure the initial state for differential evaluation, e.g., perhaps by running nominated ASL function that sets the state as necessary.
  • Alternatively, it would be nice to know if the evaluation is interacting with state that has not been meaningfully initialised.
  • It's possible to have memory loads return meaningful values, e.g., by overriding the memory load call to return random values during differential testing.
  • The evaluator can collect a trace of function calls, that can then be compared between the two evaluations.
  • It's possible to nominate two sets of overrides, one for differential testing and another for partial evaluation.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant