Azure DevOps Pipeline Optimization

[Windos]

Checklist

• I have verified this is the correct repository for opening this issue.
• I have verified no other issues exist related to my request.

Is Your Feature Request Related To A Problem? Please describe.

The Azure DevOps Pipeline that tests this collection against a number of versions Ansible is now taking an average of 2.5 hours as each version of Ansible is tested against one Windows VM in series.

Describe The Solution. Why is it needed?

It may be possible to run all tests in parallel and speed up the testing Pipeline to take about 30 to 40 minutes in total. This would involve creating a Windows VM for each Ansible version being tested, and this should not result in a net increase in VM run time due to the VMs only running for the duration of a subset of tests and being destroyed immediately after use even if other tests are still running on other VMs.

This allows for faster testing of the collection and more rapid iteration when working on it.

Additional Context

As we add more features, we add more tests and extend the run time of the test pipeline. For example, if we add tests that take an addition 5 minutes to execute, the total runtime currently would increase by 20 minutes due to the serial nature of the testing. This same change would only extend the runtime by 5 minutes if the testing was done in parallel.

Related Issues

No response