Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add mutation testing in the CI #506

Open
3 tasks
SuperFola opened this issue Dec 18, 2024 · 0 comments
Open
3 tasks

Add mutation testing in the CI #506

SuperFola opened this issue Dec 18, 2024 · 0 comments
Labels
👷 ci Related to our Continous Integration system (build, tests, auto-release...) ❗️ priority/low 🧪 tests Related to the project tests

Comments

@SuperFola
Copy link
Member

Is your feature request related to a problem?

I’d like to improve ArkScript test suites. We already have coverage, but that only tells us the code was executed, not that it’s correct.

Describe the solution you would like

To improve our tests, I’d like to add mutation testing (along side the existing fuzzing and coverage).

The idea would be to add a job running in parallel with the valgrind job. The idea is to run mutation testing on a single OS with a single compiler, to report how many tests should be improved.

https://www.youtube.com/watch?v=lhcXAnNgzlo

Is it a big modification to the language? Leave it if you don't know

  • Breaking change
  • Compiler/syntax modifications
  • Runtime modifications (standard library, modules, packages...)
@SuperFola SuperFola added ❗️ priority/low 👷 ci Related to our Continous Integration system (build, tests, auto-release...) 🧪 tests Related to the project tests labels Dec 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
👷 ci Related to our Continous Integration system (build, tests, auto-release...) ❗️ priority/low 🧪 tests Related to the project tests
Projects
None yet
Development

No branches or pull requests

1 participant