Test Builder v1.3 Punchlist

Punchlist for Test::Stream-based version of Test-Simple to be ready to ship

1. A single Test-Simple branch with proposed code and a corresponding Test-Simple dev release to CPAN (exodist)
2. Single document describing all known issues (exodist to write; andk to review)
3. Invite people to install latest dev in their daily perls for feedback

• Write document explaining how to do so and how to roll-back (rjbs and exodist)

4. Update CPAN delta smoke: compare test results for all of CPAN with latest stable and latest dev (andk, leont, xdg)

• on Perl verisions 5.8.1, 5.20.2; both with and without threads
• no new changes from previous list of incompatible modules doing unsupported things

5. Line-by-line review of $Test::Builder::Level back compatibility support (ribasushi to review; xdg to vet results)
6. bleadperl delta smoke with verbose harness output with latest stable and latest dev; review line-by-line diff (exodist and ether)

• should be no substantive changes (outside Test-Simple tests themselves)

7. Performance benchmarking — while specific workloads will vary, generally a ~15% slowdown on a "typical" workload is acceptable

• Add patches to existing bechmarking tools in Test-Simple repo (ether and bulk88)
• Run benchmarks on at least Linux (exodist) and Windows (volunteer needed)