This pytest plugin was generated with Cookiecutter along with @hackebrot's cookiecutter-pytest-plugin template.
- Generate aggregated test result group by test case name with details;
- Embed test result into html report if pytest-html is available;
- python >= 3.6
- pytest >= 6.2.2
- beautifultable >= 1.0.1
- pytest-repeat >= 0.8.0
You can install "pytest-aggreport" via pip from PyPI:
$ pip install pytest-aggreport
Pytest will automatically find the plugin and use it when you run pytest with --count
argument (enable pytest-repeat plugin). When test is done, you will see a summary report in the terminal:
$ pytest --count=5
...
------------------------- aggregate summary report -----------------
+-------------+------+------+-------+--------+-------+-------+-------+---------+
| TestCase Na | Pass | Fail | Skipp | Pass R | AVG ( | MAX ( | MIN ( | STDDEV |
| me | ed | ed | ed | ate | s) | s) | s) | (s) |
+-------------+------+------+-------+--------+-------+-------+-------+---------+
| test_pass | 5 | 0 | 0 | 100.00 | 0.1 | 0.1 | 0.1 | 0.0 |
| | | | | % | | | | |
+-------------+------+------+-------+--------+-------+-------+-------+---------+
| test_skip | 0 | 0 | 5 | 0.00% | 0.0 | 0.0 | 0.0 | 0.0 |
+-------------+------+------+-------+--------+-------+-------+-------+---------+
| test_fail | 0 | 5 | 0 | 0.00% | 0.15 | 0.15 | 0.15 | 0.0 |
+-------------+------+------+-------+--------+-------+-------+-------+---------+
| test_xpass | 5 | 0 | 0 | 100.00 | 0.1 | 0.1 | 0.1 | 0.0 |
| | | | | % | | | | |
+-------------+------+------+-------+--------+-------+-------+-------+---------+
| test_xfail | 0 | 5 | 0 | 0.00% | 0.1 | 0.1 | 0.1 | 0.0 |
+-------------+------+------+-------+--------+-------+-------+-------+---------+
...
If pytest-html is enabled(run with --html
argument), then a summary report will also be embedded in the html report:
To disable the plugin, you can use the -p
argument, for example:
$ pytest -p no:aggreport
Contributions are very welcome. Tests can be run with tox, please ensure the coverage at least stays the same before you submit a pull request.
Distributed under the terms of the MIT license, "pytest-aggreport" is free and open source software
If you encounter any problems, please file an issue along with a detailed description.