Run progress, tmt clean, docs enhancements...

• Enable and document pre-commit and autopep8
• Reorganize feature stories, fix title duplication
• Prepare/install story for package development.
• Add package preparation scenarios from Fedora CI
• Prepare/install story for released packages
• Add new stories related to package preparation
• Fix login not working for cloud images
• Work around a seccomp podman issue on centos-8
• Tag multihost tests during import from Makefile
• Adjust the simple test for ansible prepare
• Remove hardcoded ansible_python_interpreter=auto
• Fix lint and use it on the tmt repo itself
• Obsolete the minute provision plugin
• Update the documentation for contributors
• Do not assert installed packages for recommend
• Show link to the full debug log in the html report
• Implement tmt clean command
• Require a newer fmf which supports storing data
• Allow to specify port in provision.connect
• Surround classes and functions with 2 blank lines
• Fix order of imports, sort them alphabetically
• Update the provision step hardware specification
• Fix tmt plan lint for multiple configurations
• Add tmt status examples section
• Add a context adjust example for the prepare step
• Adjust the git suffix stripping for known forges
• Strip git suffix from pagure/gitlab/github repos
• Enable install plans for pull request testing
• Adjust the essential attributes description
• Document the essential class attributes
• Improve the prepare step documentation
• Correctly convert relevancy with the != operator
• Print note in report.html if it exists
• Add note about error for beakerlib results
• Adjust progress bar for the internal executor
• Add test progress bar to non-verbose mode
• Adjust the attribute linting for tests
• Lint attribute names for test
• Human friendly names for VMs

Userspace virtual provision, enable/disable plans, duration improvements...

Highlights

• Use qemu user mode in the testcloud provision
• Implement shared worktree for the tests
• Support excluding packages during installation
• Support enabling/disabling plans and stories
• Improve handling of verbose and debug options
• Add hint to stdout in case of timeout
• Improve documentation of tests, plans and stories
• Always enable force mode for display/html report
• Store relevant bugs during test import
• Export manual test case fields to nitrate

Changelog

• Create a copy of nitrate testplans for iteration
• Check the rsync as the first preparation step
• Use an empty worktree if no metadata tree found
• Adjust manual test instructions export to nitrate
• Export manual test case fields to nitrate
• Adjust the worktree implementation and test
• Implement shared worktree for the tests
• Adjust the improved verdict implementation
• Correct the verdict function, align docstring
• Print final image name in minute plugin
• Adjust the improved plan linting a bit
• Improve plan linting
• Implement port in Guest, show in verbose mode
• Use qemu user mode in the testcloud provision
• Support excluding packages during installation
• Support enabling/disabling plans and stories
• Do not link and remove general plans by default
• Improve general plans handling during test export
• Match by name prefix in discover.modified-only
• Passthrough non-zero exits for beakerlib execution
• Adjust the dry mode implementation for tmt init
• Implement dry mode for the tmt init command
• Do not use the spec release for the pip version
• Simplify story, plan and test search methods
• Do not use mutable objects as default arguments
• Prevent duplicate content in generated docs
• Ignore the nitrate migration warning during import
• Better summary for new exported tests
• Adjust exception handling in the testcloud plugin
• Make the testcloud ProvisionError more verbose
• Use IPv6 enabled 1MT network by default
• Improve debugging of tests using click runner
• Fix step selection for --before and --after
• Adjust the prepare test and pull/push enhancements
• Add prepare/shell test and pull/push enhancements
• Test filter on command line overrides config
• Improve handling of verbose and debug options
• Verify automated test case import from nitrate
• Enable copr repo even if no package is provided
• Improve documentation of tests, plans and stories
• Use fmf to store the newly created nitrate case id
• Adjust the hint about increasing the test duration
• Add hint to stdout in case of timeout
• Catch all exceptions when evaluating --condition
• Fix missing overview on the readthedocs.org site
• Adjust style of the new nitrate integration test
• Nitrate integration testsuite with requre
• Always enable force mode for display/html report
• Improve documentation, clearly show draft stories
• Test filter on command line overrides config
• Print unofficial attributes in tmt tests show -vv
• Adjust dry mode fix for test/plan/story create
• Implement dry mode for tmt test/plan/story create
• Support NO_COLOR to disable colored output
• Add test duration to results.yaml
• Adjust checking for duplicates during test export
• Prevent creating duplicate test cases in Nitrate
• Use singular for 'gate' as defined in the spec
• Fix gates conversion & drop artifacts
• Adjust a bit the shell completion instructions
• Describe how to enable shell completions
• Extend the duration test to cover positive results
• Detect timeout for Beakerlib, use TESTRESULT_STATE
• Improve tmt test path linting
• Clarify playbook path for ansible prepare plugin
• Adjust warning about the invalid disabled step
• Only warn on invalid disabled step
• Use date-service to get correct instantiation time
• Prevent keys mutation when searching plans/stories
• Cache fmf_id property
• Store relevant bugs during test import
• Avoid mutating keys default in .tests()
• Use the new execute method syntax for tmt tests
• Clean up obsolete test metadata

Core attribute link, fix prepare freeze

• Add test for prepare freeze
• Make file descriptors non-blocking
• Update the specification and stories to use link
• Implement the new core attribute 'link'

Default branches, improved filtering, tmt status...

Highlights

• Default git branch handling for libraries/discover
• Implement the new tmt status command
• Apply filters after applying defaults and conversions
• Implement tmt run --follow option for checking log
• Allow selecting only tests that have changed in git
• The first chapter of the ultimate guide to tmt

Changelog

• Show the current tmt version in the debug log
• Revert support for the 'el' distro shortcut
• Strip whitespace before relevancy comment
• Ensure rsync is installed on the guest if needed
• Use the default branch in the discover fmf plugin
• Suport the 'el' shortcut for the distro context
• Implement the 'tmt --version' option [fix #445]
• Adjust test create test, fix missing dots
• Support creating tests in the current directory
• Rename container images, update install docs
• Fixup Dockerfiles to build in quay.io.
• Support building mini and full tmt container image
• Add a Dockerfile for container with tmt
• Fix dependency error messages
• Use a better trigger name for source code changes
• Add a new 'Check Report' section to examples
• Add the --force explanation in the documentation
• Extend the test coverage to check for active runs
• Add basic test coverage for tmt status
• Restore context after processing each run
• Correctly handle an undefined step status
• Load default plan when no root is present
• Implement tmt status command
• Define command-line interface for status command
• Print library in error message during ref conflict
• Adjust the default branch handling for libraries
• Handle default branch in Library
• Adjust test duration, clean up old test metadata
• Improve timeout handling (fix an infinite loop)
• Adjust default timeout in the testcloud provision
• Remove obsolete unit test coverage for steps
• Adjust the filtering support, fix docs building
• Allow filtering using custom L1 metadata
• Allow filtering with lowercase bool names
• Handle exceptions when applying filters and conditions
• Share code for filters & conditions, test coverage
• Apply filters after applying defaults and conversions
• Fix IPv4 parsing when booting minute machine
• Remove all hacks for the old cruncher executor
• Remove the whole rhts-lint line during test import
• Remove the old convert test from unit tests
• Adjust contact handling to work with manual tests
• Fix contacts without name during tmt test import
• Finalize the specification of the 'link' attribute
• Add specification of the new core attribute 'link'
• Enough of dreaming, let's go to the forest! :)
• Update the overview of core classes, minor cleanup
• Add missing required packages for pip install
• Implement tmt run --follow option for checking log
• Extra check for required packages when using yum
• Clean up obsolete names in examples and templates
• Update the test checking for relevancy conversion
• Adjust storing test case id for new nitrate cases
• Append nitrate id when exporting instead of rewrite
• Skip prereserve check if custom flavor requested
• Use special compare operators only if minor given
• Adjust support for selecting modified tests
• Allow selecting only tests that have changed in git
• Remove the duplicate build job from packit config
• Verify the old beakerlib functions using Makefile
• Enable debug output using the TMT_DEBUG variable

Context adjust, html report, import improvements...

• Minor adjustment of the beakerlib test template
• Adjust the new test checking the error output
• Print errors to stderr
• Fix check for selecting plans during tmt run
• Update test coverage, fix finish step example
• Update spec/stories implementation coverage
• Skip import of manual cases with script
• Import header and footer from Nitrate
• Implement conversion between relevancy and adjust
• Support short options for selecting tests & plans
• Document the display and html report in the spec
• Explain the difference between fmf and tmt
• Fix the last missing framework in library tests
• Adjust the docs update and title implementation
• Implement a new story attribute 'title' (L3)
• Small documentation cleanup
• Simplify plan setup, move old plans to examples
• Store the whole debug log in the top run directory
• Add test for pip installability
• Add a new plan to cover minimal installation
• Move html report plugin into a separate subpackage
• Use 'output.txt' filename for the main test output
• Update required fmf version in setup.py
• Improve the css style for the html report
• Fix blocking read in Common.run
• Adjust a bit the improved html report
• Improve report-html --open
• Implement adjusting metadata based on the context
• Adjust the new 'html' report method
• New report --how html available
• Adjust environment import from Makefile metadata
• Import environment from Makefile metadata
• Update old beakerlib paths during tmt test import
• Adjust a little bit the user story templates
• Support libraries stored deep in the repositories
• Enable the new coverage stories section in docs
• First stories to cover tests coverage mapping
• Recommend using login shell in libvirt hints
• Use nitrate naming for the manual field export
• Export manual attribute to nitrate
• Store complete initialized data in metadata.yaml
• Merge the improved minute error messages [#425]
• Adjust a bit the minute provision error messages
• Handle testcloud problem with the images directory
• Handle tracebacks in minute provision
• Multiple enhancements for package preparation
• Gracefully handle invalid library reference

Warnings, symlinks, metadata, login...

• Convert adds extra-summary as well
• Simplify test directory copy with enabled symlinks
• Select latest minute image only from released images
• Allow specifying exact RHEL version using a short name
• Preserve symlinks during discover, pull and push
• Always run Login plugin even if step is done
• Suggest some useful aliases for common use cases
• Correct type of Tier attribute in examples
• Define basic hardware environment specification
• Import manual data for automated tests
• Tag tests which can be run under container/virtual
• Give hints to install provision plugins [fix #405]
• Handle nicely missing library metadata [fix #397]
• Update the test data directory name in the spec
• Extend duration for tests using virtualization
• Use a better name for the test data path method
• Provide aggregated test metadata for execution
• Send warnings to stderr, introduce a fail() method

Internal executor, test framework, default path, test import enhancements...

• Correctly handle framework for new plans and tests
• Move runtest.sh adjustments into a single function
• Add the executable permission to runtest.sh
• Less strict removing sourcing of rhts-environment
• Use metadata directory as the default for path
• Implement the new L1 attribute 'framework'
• Explicitly enable copr_build for pull requests
• Handle missing library in existing repository
• Update the overall tmt description and examples
• Enable builds from master in the main copr repo
• Merge packit config for copr builds from master
• Use packit repository for copr builds from master
• Gracefully handle invalid test output
• Build in COPR for master via packit
• Add hint about caching the dnf package metadata
• Add two hints about easy login for experimenting
• Merge debug messages for the minute plugin [#361]
• Adjust the minute provision debug messages wording
• Use the internal tmt executor by default
• Add more debug messages to minute provision
• Remove the remaining 'tmt test convert' references
• Prevent shebang mangling for detached executor
• Merge the minute and install plugin docs [#345]
• Adjust the minute and install plugin documentation
• Merge the manual test import documentation [#347]
• Adjust the manual test documentation wording
• Merge rhts-environment source line removal [#344]
• Adjust rhts-environment source line removal
• Add missing extra-* keys to the test import
• Add docs for manual case import
• Disable authentication when fetching libraries
• Document the install prepare method
• Document the minute provision method
• Remove sourcing of rhts-environment in runtest.sh
• Add minute to supported provision methods of prepare

Test duration, recommend libraries, retry session, manual test import...

• Adjust manual test case import from nitrate [#319]
• Move the test convert deps into a separate package
• Support importing manual test cases from Nitrate
• Merge the non-zero exit codes for linting errors
• Fix several test export issues [fix #337]
• Adjust distro checks, remove the dry parameter
• Generalized Guest.details() [fix #310]
• Adjust the test coverage for tmt plan/test lint
• Update documentation with virtualization tips
• Make sure the duration timer is always canceled
• Merge the new retry_session functionality [#328]
• Exit with non-zero code if linting fails
• Merge fix for the double fmf extension [#327]
• Prevent koji from trying to build packages on i686
• Retry requests in case of network failure
• Avoid double fmf extension when creating plans and stories
• Improve the maximum test duration handling
• Remove vagrant from tmt-all recommended packages
• Detect beakerlib libraries from recommend as well
• Simplify packit custom create archive command
• Make the httpd test example a bit more interesting
• Append dots to fix tmt run --help message summary
• Document multiple configs and extending steps

Libraries improvements, Guest cleanup, variables from files...

• Move libraries handling into a separate module
• Adjust loading variables from YAML files [#316]
• Support environment variables from YAML files
• Give a nice error for expired kerberos [fix #57]
• Merge Guest relocation and documentation [#307]
• Describe essential Guest methods in more detail
• Update test import story and documentation
• Merge extra-task as summary in test export [#304]
• Move default plan handling into a single method
• Move the Guest class from base to steps.provision
• Save root in run.yaml
• Document L1 metadata defined in the discover step
• Improve Makefile editing during test import
• Use extra-task as summary in test export
• Mention default methods in the step help message
• Handle invalid url when library provided as fmf id
• Allow library git clone to fail

Support beakerlib libraries, testcloud retry, secure discover...

• Make the discover step a little bit more secure
• Improve basic and verbose output of tmt plan show
• Improve default plan handling and more [fix #287]
• Adjust the compose check retry in testcloud
• Retry Fedora compose check in testcloud [fix #275]
• Update development section and library example
• Support fetching beakerlib libraries in discover
• Add nitrate to the setup.py extra requires
• Add a workflow-tomorrow integration test example
• Add 'duration' into the test results specification