[openssl-dev] Openssl-SNAP-20160216 issues

Richard Levitte levitte at openssl.org
Tue Feb 16 09:42:21 UTC 2016


In message <20160216090030.GA11685 at doctor.nl2k.ab.ca> on Tue, 16 Feb 2016 02:00:30 -0700, The Doctor <doctor at doctor.nl2k.ab.ca> said:

doctor> In the make test I am getting
doctor> 
doctor> TOP=.. PERL=/usr/bin/perl5 /usr/bin/perl5 run_tests.pl alltests
doctor> ../test/recipes/01-test_ordinals.t ........ ok
doctor> ../test/recipes/05-test_bf.t .............. ok
doctor> ../test/recipes/05-test_cast.t ............ ok
doctor> ../test/recipes/05-test_des.t ............. ok
doctor> ../test/recipes/05-test_hmac.t ............ ok
doctor> ../test/recipes/05-test_idea.t ............ ok
doctor> ../test/recipes/05-test_md2.t ............. skipped: md2 is not supported by this OpenSSL build
doctor> ../test/recipes/05-test_md4.t ............. ok
doctor> ../test/recipes/05-test_md5.t ............. ok
doctor> ../test/recipes/05-test_mdc2.t ............ ok
doctor> ../test/recipes/05-test_rand.t ............ 1/1
doctor> #   Failed test 'running randtest'
doctor> #   at ../test/testlib/OpenSSL/Test/Simple.pm line 70.
doctor> # Looks like you failed 1 test of 1.
doctor> ../test/recipes/05-test_rand.t ............ Dubious, test returned 1 (wstat 256, 0x100)
doctor> Failed 1/1 subtests
doctor> ../test/recipes/05-test_rc2.t ............. ok
doctor> ../test/recipes/05-test_rc4.t ............. ok
doctor> ../test/recipes/05-test_rc5.t ............. ok
doctor> ../test/recipes/05-test_rmd.t ............. ok
doctor> ../test/recipes/05-test_sha1.t ............ ok
doctor> ../test/recipes/05-test_sha256.t .......... ok
doctor> ../test/recipes/05-test_sha512.t .......... ok
doctor> ../test/recipes/05-test_wp.t .............. ok
doctor> ../test/recipes/10-test_bn.t .............. ok
doctor> ../test/recipes/10-test_exp.t ............. ok
doctor> ../test/recipes/15-test_dh.t .............. ok
doctor> ../test/recipes/15-test_dsa.t ............. ok
doctor> ../test/recipes/15-test_ec.t .............. ok
doctor> ../test/recipes/15-test_ecdh.t ............ ok
doctor> ../test/recipes/15-test_ecdsa.t ........... ok
doctor> ../test/recipes/15-test_rsa.t ............. ok
doctor> ../test/recipes/20-test_enc.t ............. 2/127
doctor> #   Failed test 'aes-128-cbc'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'aes-128-cbc base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'aes-128-ecb base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> ../test/recipes/20-test_enc.t ............. 6/127
doctor> #   Failed test 'aes-192-cbc'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'aes-192-cbc base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'aes-192-ecb'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'aes-192-ecb base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> ../test/recipes/20-test_enc.t ............. 11/127
doctor> #   Failed test 'aes-256-cbc base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'aes-256-ecb'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'aes-256-ecb base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> ../test/recipes/20-test_enc.t ............. 16/127
doctor> #   Failed test 'bf'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'bf-cbc'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'bf-cbc base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> ../test/recipes/20-test_enc.t ............. 20/127
doctor> #   Failed test 'bf-cfb'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'bf-cfb base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'bf-ecb'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'bf-ecb base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'bf-ofb'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'bf-ofb base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> ../test/recipes/20-test_enc.t ............. 26/127
doctor> #   Failed test 'camellia-128-cbc'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'camellia-128-cbc base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'camellia-128-ecb'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> ../test/recipes/20-test_enc.t ............. 30/127
doctor> #   Failed test 'camellia-192-cbc'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'camellia-192-cbc base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'camellia-192-ecb'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'camellia-192-ecb base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'camellia-256-cbc'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'camellia-256-cbc base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> ../test/recipes/20-test_enc.t ............. 36/127
doctor> #   Failed test 'camellia-256-ecb'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'camellia-256-ecb base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'cast'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'cast base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> ../test/recipes/20-test_enc.t ............. 41/127
doctor> #   Failed test 'cast-cbc base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'cast5-cbc'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'cast5-cbc base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> ../test/recipes/20-test_enc.t ............. 45/127
doctor> #   Failed test 'cast5-cfb base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'cast5-ecb'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'cast5-ecb base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'cast5-ofb'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'cast5-ofb base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> ../test/recipes/20-test_enc.t ............. 50/127
doctor> #   Failed test 'des'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'des base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'des-cbc'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'des-cbc base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'des-cfb'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> ../test/recipes/20-test_enc.t ............. 55/127
doctor> #   Failed test 'des-cfb base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'des-ecb'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'des-ecb base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'des-ede'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'des-ede base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'des-ede-cbc'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> ../test/recipes/20-test_enc.t ............. 61/127
doctor> #   Failed test 'des-ede-cfb'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'des-ede-cfb base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'des-ede-ofb'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> ../test/recipes/20-test_enc.t ............. 65/127
doctor> #   Failed test 'des-ede-ofb base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'des-ede3'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'des-ede3 base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'des-ede3-cbc'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'des-ede3-cbc base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'des-ede3-cfb'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'des-ede3-cfb base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> ../test/recipes/20-test_enc.t ............. 72/127
doctor> #   Failed test 'des-ede3-ofb'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'des-ede3-ofb base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'des-ofb'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'des-ofb base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'des3'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'des3 base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> ../test/recipes/20-test_enc.t ............. 78/127
doctor> #   Failed test 'desx'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'desx base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'idea'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'idea base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'idea-cbc'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> ../test/recipes/20-test_enc.t ............. 83/127
doctor> #   Failed test 'idea-cbc base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'idea-cfb'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'idea-cfb base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'idea-ecb'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'idea-ecb base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'idea-ofb'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> ../test/recipes/20-test_enc.t ............. 89/127
doctor> #   Failed test 'idea-ofb base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'rc2'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'rc2 base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'rc2-40-cbc'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'rc2-40-cbc base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'rc2-64-cbc'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> ../test/recipes/20-test_enc.t ............. 95/127
doctor> #   Failed test 'rc2-64-cbc base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'rc2-cbc'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'rc2-cbc base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'rc2-cfb'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'rc2-cfb base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> ../test/recipes/20-test_enc.t ............. 100/127
doctor> #   Failed test 'rc2-ecb'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'rc2-ecb base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'rc2-ofb'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> ../test/recipes/20-test_enc.t ............. 103/127
doctor> #   Failed test 'rc2-ofb base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'rc4'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'rc4 base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'rc4-40'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'rc4-40 base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'rc5'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> ../test/recipes/20-test_enc.t ............. 109/127
doctor> #   Failed test 'rc5 base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'rc5-cbc'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'rc5-cbc base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'rc5-cfb'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'rc5-cfb base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'rc5-ecb'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> ../test/recipes/20-test_enc.t ............. 115/127
doctor> #   Failed test 'rc5-ecb base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'rc5-ofb'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'rc5-ofb base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'seed'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> ../test/recipes/20-test_enc.t ............. 119/127
doctor> #   Failed test 'seed base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'seed-cbc'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'seed-cbc base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'seed-cfb'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'seed-cfb base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'seed-ecb'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> ../test/recipes/20-test_enc.t ............. 125/127
doctor> #   Failed test 'seed-ofb'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> 
doctor> #   Failed test 'seed-ofb base64'
doctor> #   at ../test/recipes/20-test_enc.t line 54.
doctor> # Looks like you failed 116 tests of 127.
doctor> ../test/recipes/20-test_enc.t ............. Dubious, test returned 116 (wstat 29696, 0x7400)
doctor> Failed 116/127 subtests
doctor> ../test/recipes/25-test_crl.t ............. ok
doctor> ../test/recipes/25-test_gen.t ............. ok
doctor> ../test/recipes/25-test_pkcs7.t ........... ok
doctor> ../test/recipes/25-test_req.t ............. ok
doctor> ../test/recipes/25-test_sid.t ............. ok
doctor> ../test/recipes/25-test_verify.t .......... ok
doctor> ../test/recipes/25-test_x509.t ............ ok
doctor> ../test/recipes/30-test_engine.t .......... ok
doctor> ../test/recipes/30-test_evp.t ............. 1/1
doctor> #   Failed test 'running evp_test evptests.txt'
doctor> #   at ../test/recipes/30-test_evp.t line 11.
doctor> # Looks like you failed 1 test of 1.
doctor> ../test/recipes/30-test_evp.t ............. Dubious, test returned 1 (wstat 256, 0x100)
doctor> Failed 1/1 subtests
doctor> ../test/recipes/30-test_evp_extra.t ....... 1/1
doctor> #   Failed test 'running evp_extra_test'
doctor> #   at ../test/recipes/30-test_evp_extra.t line 11.
doctor> # Looks like you failed 1 test of 1.
doctor> ../test/recipes/30-test_evp_extra.t ....... Dubious, test returned 1 (wstat 256, 0x100)
doctor> Failed 1/1 subtests
doctor> ../test/recipes/30-test_pbelu.t ........... ok
doctor> ../test/recipes/40-test_rehash.t .......... 2/5
doctor> #   Failed test 'Testing that we aren't running as a priviledged user, such as root'
doctor> #   at ../test/recipes/40-test_rehash.t line 41.
doctor> # Looks like you failed 1 test of 5.
doctor> ../test/recipes/40-test_rehash.t .......... Dubious, test returned 1 (wstat 256, 0x100)
doctor> Failed 1/5 subtests
doctor>         (less 1 skipped subtest: 3 okay)
doctor> ../test/recipes/70-test_clienthello.t ..... 1/1
doctor> #   Failed test 'running clienthellotest'
doctor> #   at ../test/recipes/70-test_clienthello.t line 13.
doctor> # Looks like you failed 1 test of 1.
doctor> ../test/recipes/70-test_clienthello.t ..... Dubious, test returned 1 (wstat 256, 0x100)
doctor> Failed 1/1 subtests
doctor> ../test/recipes/70-test_packet.t .......... 1/1
doctor> #   Failed test 'running packettest'
doctor> #   at ../test/testlib/OpenSSL/Test/Simple.pm line 70.
doctor> # Looks like you failed 1 test of 1.
doctor> ../test/recipes/70-test_packet.t .......... Dubious, test returned 1 (wstat 256, 0x100)
doctor> Failed 1/1 subtests
doctor> ../test/recipes/70-test_sslcertstatus.t ...                                    
doctor> 
doctor> 
doctor> 
doctor> All right the ../test/recipes/70-test_sslcertstatus.t  is hanging into infinity.
doctor> 
doctor> What can do to see why these tests are failing?

You can do this:

HARNESS_VERBOSE=yes make test

Fair warning, that's a *lot* of output

If you want to be selective, you can pick specific tests into the
TESTS variable, like this:

HARNESS_VERBOSE=yes make test TESTS='tesl_ssl test_packet'

The words in that variable are taken from the test recipes, it's the
{name} part in nn-{name}.t, so for the recipe file
../test/recipes/70-test_clienthello.t, the name to put into the TESTS
variable is test_clienthello.

Cheers,
Richard

-- 
Richard Levitte         levitte at openssl.org
OpenSSL Project         http://www.openssl.org/~levitte/


More information about the openssl-dev mailing list