- Added ability to specify
.skip
files. If a test contains a.skip
file in the same directory as the output, then the test will not be run at all. - Correctly handle non-TTY output streams: Do not attempt to stream updates to the test counter.
- Internal: Added the
Status
data structure to current status of the executor and printing out details to the user.
- Summary reports the number of remaining tests
- Internal: Replace
structopt
withargh
- BREAKING: The default test reporter now suppresses names of passing tests by default and prints out test results as soon as they are done.
- Added
-n
flag to print out the commands to be run to execute a test. - Internal: Complete rewrite to separate out the frontend and backend, improve performance, and add documentation.
Yanked due to performance problems.
- Added
--jobs
flag to limit the number of jobs that can run in parallel. Defaults to number of logical cpus. - Internal: Use std library sequential forms of
fs::*
andprocess::command
instead oftokio
equivalents so that the number of threads corresponds one-to-one with spawned processes.
- Internal: Use
buffered_unordered
to limit two parallel test suite runs at a time. - Diff mode: Trim lines that were not changed to 80 characters.
- Asynchronous test printing: Print out test suites as they finish instead of waiting on all test suites.
- Remove support for regex based
--only
filters. Pre-filters--include
and--exclude
subsume them.
- Include and exclude regexes match on
<suite-name>:<path>
strings.- To select a test suite, simply do
runt -i "suite name"
- To select a path, simply do
runt -i "path"
- To select a path for a test suite, do
runt -i "suite name:path"
- To select a test suite, simply do
- Implement "pre-filters"
--include
: Only run tests that match given regex.--exclude
: Exclude tests that match given regex.
- Modification to test suite name printing: When all tests from a test suite are suppressed, don't print the name.
- Code reorganization.
- Bug fix: Print out the right
runt
command when runt configuration version does not match.
- Add
ver
andexpect_dir
configuration options to runt.toml.
- CLI uses "." as the default directory to find
runt.toml
. - Use distinct symbols to show test states.
- Remove
name
field from the configuration.
- Execute test suites in parallel. If certain test suites take longer to run, they will not block the execution of other test suites.
- Suppress reporting when there are not tests of a certain category (fail, miss, or correct).
- Change the expect string format to be:
and suppress stderr when its empty and code when its zero.
<STDOUT> ---CODE--- <exit code> ---STDERR--- <stderr>
- Execute all commands in the directory where
runt.toml
resides. - Print out test suite name and the total number of test states.
- Return code is the number of failing tests.
- Fix help display for --only flag to say
miss
instead ofmissing
.
Initial release.