[openssl-dev] Some tests fail on the current/latest SNAP

Blumenthal, Uri - 0553 - MITLL uri at ll.mit.edu
Fri Sep 18 16:18:53 UTC 2015 

Richard,

Thank you for your help! Unfortunately, the problem persists:

testing...
make[1]: Entering directory `/media/uri/Src/openssl/test'
make[2]: Entering directory `/media/uri/Src/openssl'
making all in apps...
make[3]: Entering directory `/media/uri/Src/openssl/apps'
make[3]: Nothing to be done for `all'.
make[3]: Leaving directory `/media/uri/Src/openssl/apps'
make[2]: Leaving directory `/media/uri/Src/openssl'
TOP=.. PERL=/usr/bin/perl /usr/bin/perl run_tests.pl alltests
../test/recipes/00-check_testexes.t ....... ok
../test/recipes/05-test_bf.t .............. ok
../test/recipes/05-test_cast.t ............ ok
../test/recipes/05-test_des.t ............. ok
../test/recipes/05-test_hmac.t ............ ok
../test/recipes/05-test_idea.t ............ ok
../test/recipes/05-test_md2.t ............. ok
../test/recipes/05-test_md4.t ............. ok
../test/recipes/05-test_md5.t ............. ok
../test/recipes/05-test_mdc2.t ............ ok
../test/recipes/05-test_rand.t ............ ok
../test/recipes/05-test_rc2.t ............. ok
../test/recipes/05-test_rc4.t ............. ok
../test/recipes/05-test_rc5.t ............. ok
../test/recipes/05-test_rmd.t ............. ok
../test/recipes/05-test_sha1.t ............ ok
../test/recipes/05-test_sha256.t .......... ok
../test/recipes/05-test_sha512.t .......... ok
../test/recipes/05-test_wp.t .............. ok
../test/recipes/10-test_bn.t .............. ok
../test/recipes/10-test_exp.t ............. ok
../test/recipes/15-test_dh.t .............. ok
../test/recipes/15-test_dsa.t ............. ok
../test/recipes/15-test_ec.t .............. ok
../test/recipes/15-test_ecdh.t ............ ok
../test/recipes/15-test_ecdsa.t ........... ok
../test/recipes/15-test_rsa.t ............. ok
../test/recipes/20-test_enc.t ............. ok
../test/recipes/25-test_crl.t ............. ok
../test/recipes/25-test_gen.t ............. ok
../test/recipes/25-test_pkcs7.t ........... ok
../test/recipes/25-test_req.t ............. ok
../test/recipes/25-test_sid.t ............. ok
../test/recipes/25-test_verify.t .......... ok
../test/recipes/25-test_x509.t ............ ok
../test/recipes/30-test_engine.t .......... ok
../test/recipes/30-test_evp.t ............. ok
../test/recipes/30-test_evp_extra.t ....... ok
../test/recipes/30-test_pbelu.t ........... ok
../test/recipes/40-test_rehash.t .......... ok
../test/recipes/70-test_clienthello.t ..... ok
../test/recipes/70-test_packet.t .......... ok
Use of uninitialized value within %message_type in concatenation (.) or
string at ../util/TLSProxy/Message.pm line 202, <> line 751.
Changed peer, but we still have fragment data
# Looks like your test exited with 255 before it could output anything.
../test/recipes/70-test_sslextension.t ....
Dubious, test returned 255 (wstat 65280, 0xff00)
Failed 1/1 subtests
Use of uninitialized value within %message_type in concatenation (.) or
string at ../util/TLSProxy/Message.pm line 202, <> line 751.
Changed peer, but we still have fragment data
# Looks like your test exited with 255 before it could output anything.
../test/recipes/70-test_sslsessiontick.t ..
Dubious, test returned 255 (wstat 65280, 0xff00)
Failed 5/5 subtests
../test/recipes/70-test_sslskewith0p.t .... ok
Use of uninitialized value within %message_type in concatenation (.) or
string at ../util/TLSProxy/Message.pm line 202, <> line 751.
Changed peer, but we still have fragment data
# Looks like your test exited with 255 before it could output anything.
../test/recipes/70-test_sslvertol.t .......
Dubious, test returned 255 (wstat 65280, 0xff00)
Failed 2/2 subtests
../test/recipes/70-test_verify_extra.t .... ok
../test/recipes/80-test_ca.t .............. ok
    # Looks like you planned 11 tests but ran 20.

#   Failed test 'CMS <=> CMS consistency tests, modified key parameters
# '
#   at ../test/recipes/80-test_cms.t line 460.
# Looks like you failed 1 test of 4.
../test/recipes/80-test_cms.t .............
Dubious, test returned 1 (wstat 256, 0x100)
Failed 1/4 subtests
../test/recipes/80-test_ocsp.t ............ ok
../test/recipes/80-test_ssl.t ............. ok
../test/recipes/80-test_tsa.t ............. ok
../test/recipes/90-test_constant_time.t ... ok
../test/recipes/90-test_gmdiff.t .......... ok
../test/recipes/90-test_gost2814789.t ..... ok
../test/recipes/90-test_heartbeat.t ....... ok
../test/recipes/90-test_ige.t ............. ok
../test/recipes/90-test_jpake.t ........... ok
../test/recipes/90-test_np.t .............. ok
../test/recipes/90-test_p5_crpt2.t ........ ok
../test/recipes/90-test_secmem.t .......... ok
../test/recipes/90-test_srp.t ............. ok
../test/recipes/90-test_v3name.t .......... ok

Test Summary Report
-------------------
../test/recipes/70-test_sslextension.t  (Wstat: 65280 Tests: 0 Failed: 0)
  Non-zero exit status: 255
  Parse errors: Bad plan.  You planned 1 tests but ran 0.
../test/recipes/70-test_sslsessiontick.t (Wstat: 65280 Tests: 0 Failed: 0)
  Non-zero exit status: 255
  Parse errors: Bad plan.  You planned 5 tests but ran 0.
../test/recipes/70-test_sslvertol.t     (Wstat: 65280 Tests: 0 Failed: 0)
  Non-zero exit status: 255
  Parse errors: Bad plan.  You planned 2 tests but ran 0.
../test/recipes/80-test_cms.t           (Wstat: 256 Tests: 4 Failed: 1)
  Failed test:  4
  Non-zero exit status: 1
Files=63, Tests=324, 30 wallclock secs ( 0.31 usr  0.08 sys + 19.13 cusr
8.61 csys = 28.13 CPU)
Result: FAIL
Failed 4/63 test programs. 1/324 subtests failed.
make[1]: *** [tests] Error 255
make[1]: Leaving directory `/media/uri/Src/openssl/test'
make: *** [tests] Error 2



What can we (I :) do to either remedy it, or provide you more info to find
the cause?
-- 
Regards,
Uri Blumenthal





On 9/18/15, 2:27 , "Richard Levitte" <richard at levitte.org> wrote:

>I can't reproduce it either, but judging from the line number, it
>looks like a surprise unknown message type.  Uri, the attached patch
>and the following command line might help clear this up:
>
>    HARNESS_VERBOSE=yes make TESTS=test_sslextension test
>
>Cheers,
>Richard
>
>In message <55FB36B5.40105 at openssl.org> on Thu, 17 Sep 2015 22:55:01
>+0100, Matt Caswell <matt at openssl.org> said:
>
>matt> Hmmm. I cannot reproduce this. Is anyone else seeing this?
>matt> 
>matt> Matt
>matt> 
>matt> On 17/09/15 20:15, Blumenthal, Uri - 0553 - MITLL wrote:
>matt> > $ apps/openssl$ openssl version
>matt> > OpenSSL 1.1.0-dev xx XXX xxxx
>matt> > $ make test
>matt> > testing...
>matt> > make[1]: Entering directory `/media/uri/Src/openssl/test'
>matt> > make[2]: Entering directory `/media/uri/Src/openssl'
>matt> > making all in apps...
>matt> > make[3]: Entering directory `/media/uri/Src/openssl/apps'
>matt> > make[3]: Nothing to be done for `all'.
>matt> > make[3]: Leaving directory `/media/uri/Src/openssl/apps'
>matt> > make[2]: Leaving directory `/media/uri/Src/openssl'
>matt> > TOP=.. PERL=/usr/bin/perl /usr/bin/perl run_tests.pl alltests
>matt> > ../test/recipes/00-check_testexes.t ....... ok
>matt> > ../test/recipes/05-test_bf.t .............. ok
>matt> > ../test/recipes/05-test_cast.t ............ ok
>matt> > ../test/recipes/05-test_des.t ............. ok
>matt> > ../test/recipes/05-test_hmac.t ............ ok
>matt> > ../test/recipes/05-test_idea.t ............ ok
>matt> > ../test/recipes/05-test_md2.t ............. ok
>matt> > ../test/recipes/05-test_md4.t ............. ok
>matt> > ../test/recipes/05-test_md5.t ............. ok
>matt> > ../test/recipes/05-test_mdc2.t ............ ok
>matt> > ../test/recipes/05-test_rand.t ............ ok
>matt> > ../test/recipes/05-test_rc2.t ............. ok
>matt> > ../test/recipes/05-test_rc4.t ............. ok
>matt> > ../test/recipes/05-test_rc5.t ............. ok
>matt> > ../test/recipes/05-test_rmd.t ............. ok
>matt> > ../test/recipes/05-test_sha1.t ............ ok
>matt> > ../test/recipes/05-test_sha256.t .......... ok
>matt> > ../test/recipes/05-test_sha512.t .......... ok
>matt> > ../test/recipes/05-test_wp.t .............. ok
>matt> > ../test/recipes/10-test_bn.t .............. ok
>matt> > ../test/recipes/10-test_exp.t ............. ok
>matt> > ../test/recipes/15-test_dh.t .............. ok
>matt> > ../test/recipes/15-test_dsa.t ............. ok
>matt> > ../test/recipes/15-test_ec.t .............. ok
>matt> > ../test/recipes/15-test_ecdh.t ............ ok
>matt> > ../test/recipes/15-test_ecdsa.t ........... ok
>matt> > ../test/recipes/15-test_rsa.t ............. ok
>matt> > ../test/recipes/20-test_enc.t ............. ok
>matt> > ../test/recipes/25-test_crl.t ............. ok
>matt> > ../test/recipes/25-test_gen.t ............. ok
>matt> > ../test/recipes/25-test_pkcs7.t ........... ok
>matt> > ../test/recipes/25-test_req.t ............. ok
>matt> > ../test/recipes/25-test_sid.t ............. ok
>matt> > ../test/recipes/25-test_verify.t .......... ok
>matt> > ../test/recipes/25-test_x509.t ............ ok
>matt> > ../test/recipes/30-test_engine.t .......... ok
>matt> > ../test/recipes/30-test_evp.t ............. ok
>matt> > ../test/recipes/30-test_evp_extra.t ....... ok
>matt> > ../test/recipes/30-test_pbelu.t ........... ok
>matt> > ../test/recipes/40-test_rehash.t .......... ok
>matt> > ../test/recipes/70-test_clienthello.t ..... ok
>matt> > ../test/recipes/70-test_packet.t .......... ok
>matt> > Use of uninitialized value within %message_type in concatenation
>(.) or
>matt> > string at ../util/TLSProxy/Message.pm line 202, <> line 751.
>matt> > Changed peer, but we still have fragment data
>matt> > # Looks like your test exited with 255 before it could output
>anything.
>matt> > ../test/recipes/70-test_sslextension.t ....
>matt> > Dubious, test returned 255 (wstat 65280, 0xff00)
>matt> > Failed 1/1 subtests
>matt> > Use of uninitialized value within %message_type in concatenation
>(.) or
>matt> > string at ../util/TLSProxy/Message.pm line 202, <> line 751.
>matt> > Changed peer, but we still have fragment data
>matt> > # Looks like your test exited with 255 before it could output
>anything.
>matt> > ../test/recipes/70-test_sslsessiontick.t ..
>matt> > Dubious, test returned 255 (wstat 65280, 0xff00)
>matt> > Failed 5/5 subtests
>matt> > ../test/recipes/70-test_sslskewith0p.t .... ok
>matt> > Use of uninitialized value within %message_type in concatenation
>(.) or
>matt> > string at ../util/TLSProxy/Message.pm line 202, <> line 751.
>matt> > Changed peer, but we still have fragment data
>matt> > # Looks like your test exited with 255 before it could output
>anything.
>matt> > ../test/recipes/70-test_sslvertol.t .......
>matt> > Dubious, test returned 255 (wstat 65280, 0xff00)
>matt> > Failed 2/2 subtests
>matt> > ../test/recipes/70-test_verify_extra.t .... ok
>matt> > ../test/recipes/80-test_ca.t .............. ok
>matt> >     # Looks like you planned 11 tests but ran 20.
>matt> > 
>matt> > #   Failed test 'CMS <=> CMS consistency tests, modified key
>parameters
>matt> > # '
>matt> > #   at ../test/recipes/80-test_cms.t line 460.
>matt> > # Looks like you failed 1 test of 4.
>matt> > ../test/recipes/80-test_cms.t .............
>matt> > Dubious, test returned 1 (wstat 256, 0x100)
>matt> > Failed 1/4 subtests
>matt> > ../test/recipes/80-test_ocsp.t ............ ok
>matt> > ../test/recipes/80-test_ssl.t ............. ok
>matt> > ../test/recipes/80-test_tsa.t ............. ok
>matt> > ../test/recipes/90-test_constant_time.t ... ok
>matt> > ../test/recipes/90-test_gmdiff.t .......... ok
>matt> > ../test/recipes/90-test_gost2814789.t ..... ok
>matt> > ../test/recipes/90-test_heartbeat.t ....... ok
>matt> > ../test/recipes/90-test_ige.t ............. ok
>matt> > ../test/recipes/90-test_jpake.t ........... ok
>matt> > ../test/recipes/90-test_np.t .............. ok
>matt> > ../test/recipes/90-test_p5_crpt2.t ........ ok
>matt> > ../test/recipes/90-test_secmem.t .......... ok
>matt> > ../test/recipes/90-test_srp.t ............. ok
>matt> > ../test/recipes/90-test_v3name.t .......... ok
>matt> > 
>matt> > Test Summary Report
>matt> > -------------------
>matt> > ../test/recipes/70-test_sslextension.t  (Wstat: 65280 Tests: 0
>Failed: 0)
>matt> >   Non-zero exit status: 255
>matt> >   Parse errors: Bad plan.  You planned 1 tests but ran 0.
>matt> > ../test/recipes/70-test_sslsessiontick.t (Wstat: 65280 Tests: 0
>Failed: 0)
>matt> >   Non-zero exit status: 255
>matt> >   Parse errors: Bad plan.  You planned 5 tests but ran 0.
>matt> > ../test/recipes/70-test_sslvertol.t     (Wstat: 65280 Tests: 0
>Failed: 0)
>matt> >   Non-zero exit status: 255
>matt> >   Parse errors: Bad plan.  You planned 2 tests but ran 0.
>matt> > ../test/recipes/80-test_cms.t           (Wstat: 256 Tests: 4
>Failed: 1)
>matt> >   Failed test:  4
>matt> >   Non-zero exit status: 1
>matt> > Files=63, Tests=324, 27 wallclock secs ( 0.32 usr  0.05 sys +
>18.40 cusr
>matt> >  8.32 csys = 27.09 CPU)
>matt> > Result: FAIL
>matt> > Failed 4/63 test programs. 1/324 subtests failed.
>matt> > make[1]: *** [tests] Error 255
>matt> > make[1]: Leaving directory `/media/uri/Src/openssl/test'
>matt> > make: *** [tests] Error 2
>matt> > $ gcc -v
>matt> > Using built-in specs.
>matt> > COLLECT_GCC=gcc
>matt> > COLLECT_LTO_WRAPPER=/usr/lib/gcc/x86_64-linux-gnu/4.8/lto-wrapper
>matt> > Target: x86_64-linux-gnu
>matt> > Configured with: ../src/configure -v --with-pkgversion='Ubuntu
>matt> > 4.8.4-2ubuntu1~14.04'
>matt> > --with-bugurl=file:///usr/share/doc/gcc-4.8/README.Bugs
>matt> > --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++
>--prefix=/usr
>matt> > --program-suffix=-4.8 --enable-shared --enable-linker-build-id
>matt> > --libexecdir=/usr/lib --without-included-gettext
>--enable-threads=posix
>matt> > --with-gxx-include-dir=/usr/include/c++/4.8 --libdir=/usr/lib
>matt> > --enable-nls --with-sysroot=/ --enable-clocale=gnu
>matt> > --enable-libstdcxx-debug --enable-libstdcxx-time=yes
>matt> > --enable-gnu-unique-object --disable-libmudflap --enable-plugin
>matt> > --with-system-zlib --disable-browser-plugin --enable-java-awt=gtk
>matt> > --enable-gtk-cairo
>matt> > --with-java-home=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64/jre
>matt> > --enable-java-home
>matt> > --with-jvm-root-dir=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64
>matt> > --with-jvm-jar-dir=/usr/lib/jvm-exports/java-1.5.0-gcj-4.8-amd64
>matt> > --with-arch-directory=amd64
>matt> > --with-ecj-jar=/usr/share/java/eclipse-ecj.jar --enable-objc-gc
>matt> > --enable-multiarch --disable-werror --with-arch-32=i686
>--with-abi=m64
>matt> > --with-multilib-list=m32,m64,mx32 --with-tune=generic
>matt> > --enable-checking=release --build=x86_64-linux-gnu
>matt> > --host=x86_64-linux-gnu --target=x86_64-linux-gnu
>matt> > Thread model: posix
>matt> > gcc version 4.8.4 (Ubuntu 4.8.4-2ubuntu1~14.04)
>matt> > -- 
>matt> > Regards,
>matt> > Uri Blumenthal
>matt> > 
>matt> > 
>matt> > _______________________________________________
>matt> > openssl-dev mailing list
>matt> > To unsubscribe:
>https://mta.openssl.org/mailman/listinfo/openssl-dev
>matt> > 
>matt> _______________________________________________
>matt> openssl-dev mailing list
>matt> To unsubscribe: https://mta.openssl.org/mailman/listinfo/openssl-dev
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 4308 bytes
Desc: not available
URL: <http://mta.openssl.org/pipermail/openssl-dev/attachments/20150918/cb65bf9c/attachment-0001.bin>

More information about the openssl-dev mailing list