Lines Matching full:tests

1 Using OpenSSL Tests
11 **Warning:** you MUST run the tests from an unprivileged account
14 If some tests fail, take a look at the section Test Failures below.
19 If some tests fail, look at the output.  There may be reasons for the failure
30 Verbosity on failed (sub-)tests only
35 Verbosity on failed (sub-)tests, in addition progress on succeeded (sub-)tests
40 If you want to run just one or a few specific tests, you can use
41 the make variable TESTS to specify them, like this:
43     $ make TESTS='test_rsa test_dsa' test            # Unix
44     $ mms/macro="TESTS=test_rsa test_dsa" test       ! OpenVMS
45     $ nmake TESTS="test_rsa test_dsa" test           # Windows
49     $ make test TESTS='test_rsa test_dsa' VF=1
50     $ make test TESTS="test_cmp_*" VFP=1
52 You can find the list of available tests like this:
54     $ make list-tests                                # Unix
55     $ mms list-tests                                 ! OpenVMS
56     $ nmake list-tests                               # Windows
64 For more details on how the `make` variables `TESTS` can be used,
65 see section Running Selected Tests below.
67 Running Selected Tests
70 The `make` variable `TESTS` supports a versatile set of space separated tokens
71 with which you can specify a set of tests to be performed.  With a "current
72 set of tests" in mind, initially being empty, here are the possible tokens:
74      alltests      The current set of tests becomes the whole set of available
75                    tests (as listed when you do 'make list-tests' or similar).
77      xxx           Adds the test 'xxx' to the current set of tests.
79     -xxx           Removes 'xxx' from the current set of tests.  If this is the
80                    first token in the list, the current set of tests is first
81                    assigned the whole set of available tests, effectively making
82                    this token equivalent to TESTS="alltests -xxx".
85                    set of tests.
87     -nn            Removes the test group 'nn' from the current set of tests.
89                    tests is first assigned the whole set of available tests,
91                    TESTS="alltests -xxx".
99 Run all tests except for the fuzz tests:
101     $ make TESTS='-test_fuzz*' test
105     $ make TESTS='alltests -test_fuzz*' test
107 Run all tests that have a name starting with "test_ssl" but not those
110     $ make TESTS='test_ssl* -test_ssl_*' test
114     $ make TESTS='10' test
116 Run all tests except the slow group (group 99):
118     $ make TESTS='-99' test
120 Run all tests in test groups 80 to 99 except for tests in group 90:
122     $ make TESTS='[89]? -90' test
124 To run specific fuzz tests you can use for instance:
126     $ make test TESTS='test_fuzz_cmp test_fuzz_cms'
133 Running Tests in Parallel
136 By default the test harness will execute the selected tests sequentially.
148 To run up to four tests in parallel at any given time:
155 By default, the test harness will execute tests in the order they were added.
159 environment variable to this value will rerun the tests in the same
168 To run the tests using the order defined by the random seed `42`: