simplerunner

##Info

This is to be a part of the maybe to be runner. This can also be run itself.

#Get started

##Installation:

-> edit sr(-script) as instructed inside of it
-> cp sr ../bin/ if you want to

usage(run-script):

$ bash run <language> <stub> <conf> [certs] [curpath] [stubname] [timeout(in seconds)]

if ( you want to set some of the aguments to default) {
  replace the arguments with '_' characters.
}

usage(sr-script):

$ sr <certspath> <command> <run-path> <stub> <backends>

##Example usage:

sr-script (simplerunner)

example 1:
$ cd ../stubs/[stub]              #move to the stub folder you want to run
$ sr                              #execute sr-script -> run simplerunner against default backends

example 2:
$ sr -- -- -- -- trytls-localhost

example 3:
$ sr -- java -- -- java-https:Run badssl-all

example 4(for example: linux, c-openssl):
$ sr /etc/ssl/certs/ca-certificates.crt

settings example 1:
$ sr settings parallel -> run tests in parallel

settings example 2:
$ sr settings 'parallel 180' -> run tests in parallel, set timeout 180 seconds

settings example 3:
$ sr settings 'parallel+print-error 90' -> run tests in parallel + print-error(print errors as they appear), set timeout 90 sec

Run-script (run, sr and bashtls use this)

against badssl (run the code on your computer and you will see the colorcoded version)

• Green/Blue = Good
• Red = Bad
• White = Middle/OK?
• Others = Can't say (but not bad, either good or middle)

$ bash run mono '../trytls/stubs/cSharp-Net/run.exe' 'conf/badssl-all' _ _ CSharp-Net | sort

[cSharp-Net][ PASS ][REJECT][ dh480                         ][dh480.badssl.com]
[cSharp-Net][ PASS ][REJECT][ dsdtestprovider               ][dsdtestprovider.badssl.com]
[cSharp-Net][ PASS ][REJECT][ edellroot                     ][edellroot.badssl.com]
[cSharp-Net][ PASS ][REJECT][ self-signed                   ][self-signed.badssl.com]
[cSharp-Net][ PASS ][REJECT][ superfish                     ][superfish.badssl.com]
[cSharp-Net][ PASS ][REJECT][ untrusted-root                ][untrusted-root.badssl.com]
[cSharp-Net][ PASS ][REJECT][ wrong host                    ][wrong.host.badssl.com]
[cSharp-Net][ PASS ][ACCEPT][ sha-256                       ][sha256.badssl.com]
[cSharp-Net][ PASS ][ACCEPT][ supports SNI                  ][badssl.com]
[cSharp-Net][ OK?  ][ UNSUPPORTED  ][ disable ca-bundles            ][badssl.com]
[cSharp-Net][ OK?  ][REJECT][ dh1024                        ][dh1024.badssl.com]
[cSharp-Net][ OK?  ][REJECT][ dh-small-subgroup             ][dh-small-subgroup.badssl.com]
[cSharp-Net][ OK?  ][REJECT][ incomplete-chain              ][incomplete-chain.badssl.com]
[cSharp-Net][ OK?  ][REJECT][ mozilla-intermediate          ][mozilla-intermediate.badssl.com]
[cSharp-Net][ OK?  ][REJECT][ mozilla-modern                ][mozilla-modern.badssl.com]
[cSharp-Net][ OK?  ][REJECT][ subdomain.preloaded-hsts      ][subdomain.preloaded-hsts.badssl.com]
[cSharp-Net][ OK?  ][ACCEPT][ cbc                           ][cbc.badssl.com]
[cSharp-Net][ OK?  ][ACCEPT][ hsts                          ][hsts.badssl.com]
[cSharp-Net][ OK?  ][ACCEPT][ mixed                         ][mixed.badssl.com]
[cSharp-Net][ OK?  ][ACCEPT][ mixed-favicon                 ][mixed-favicon.badssl.com]
[cSharp-Net][ OK?  ][ACCEPT][ mixed-script                  ][mixed-script.badssl.com]
[cSharp-Net][ OK?  ][ACCEPT][ mozilla-old                   ][mozilla-old.badssl.com]
[cSharp-Net][ OK?  ][ACCEPT][ pinning-test                  ][pinning-test.badssl.com]
[cSharp-Net][ OK?  ][ACCEPT][ preloaded-hsts                ][preloaded-hsts.badssl.com]
[cSharp-Net][ OK?  ][ACCEPT][ rc4                           ][rc4.badssl.com]
[cSharp-Net][ OK?  ][ACCEPT][ rsa8192                       ][rsa8192.badssl.com]
[cSharp-Net][ OK?  ][ACCEPT][ sha1-2016                     ][sha1-2016.badssl.com]
[cSharp-Net][ OK?  ][ACCEPT][ sha1-2017                     ][sha1-2017.badssl.com]
[cSharp-Net][ OK?  ][ACCEPT][ upgrade                       ][upgrade.badssl.com]
[cSharp-Net][ OK?  ][ACCEPT][ very                          ][very.badssl.com]
[cSharp-Net][ FAIL ][REJECT][ 10000-sans (Bad in ten years) ][10000-sans.badssl.com]
[cSharp-Net][ FAIL ][REJECT][ 1000-sans                     ][1000-sans.badssl.com]
[cSharp-Net][ FAIL ][REJECT][ dh2048                        ][dh2048.badssl.com]
[cSharp-Net][ FAIL ][ACCEPT][ expired                       ][expired.badssl.com]


...

against trytls backend

$ bash run python3 '../trytls/stubs/python3-urllib/run.py' '../trytls/backends/trytls/tmp/conf' ../trytls/backends/trytls/tmp/certs

or 

$ bash run mono '../trytls/stubs/vb-Net/run.exe' '../trytls/backends/trytls/tmp/conf-nocerts'

or

$ bash run python3 '../trytls/stubs/python3-urllib/run.py' 'conf/trytls-localhost' ../trytls/backends/trytls/tmp/certs
* if 

or

$ bash run mono '../trytls/stubs/FSharp-Net/run.exe' 'conf/trytls-localhost-nocerts'
...