[openssl-dev] Some tests fail on the current/latest SNAP

Fri Sep 18 06:27:41 UTC 2015

I can't reproduce it either, but judging from the line number, it
looks like a surprise unknown message type.  Uri, the attached patch
and the following command line might help clear this up:

    HARNESS_VERBOSE=yes make TESTS=test_sslextension test

Cheers,
Richard

In message <55FB36B5.40105 at openssl.org> on Thu, 17 Sep 2015 22:55:01 +0100, Matt Caswell <matt at openssl.org> said:

matt> Hmmm. I cannot reproduce this. Is anyone else seeing this?
matt> 
matt> Matt
matt> 
matt> On 17/09/15 20:15, Blumenthal, Uri - 0553 - MITLL wrote:
matt> > $ apps/openssl$ openssl version
matt> > OpenSSL 1.1.0-dev xx XXX xxxx
matt> > $ make test
matt> > testing...
matt> > make[1]: Entering directory `/media/uri/Src/openssl/test'
matt> > make[2]: Entering directory `/media/uri/Src/openssl'
matt> > making all in apps...
matt> > make[3]: Entering directory `/media/uri/Src/openssl/apps'
matt> > make[3]: Nothing to be done for `all'.
matt> > make[3]: Leaving directory `/media/uri/Src/openssl/apps'
matt> > make[2]: Leaving directory `/media/uri/Src/openssl'
matt> > TOP=.. PERL=/usr/bin/perl /usr/bin/perl run_tests.pl alltests
matt> > ../test/recipes/00-check_testexes.t ....... ok
matt> > ../test/recipes/05-test_bf.t .............. ok
matt> > ../test/recipes/05-test_cast.t ............ ok
matt> > ../test/recipes/05-test_des.t ............. ok
matt> > ../test/recipes/05-test_hmac.t ............ ok
matt> > ../test/recipes/05-test_idea.t ............ ok
matt> > ../test/recipes/05-test_md2.t ............. ok
matt> > ../test/recipes/05-test_md4.t ............. ok
matt> > ../test/recipes/05-test_md5.t ............. ok
matt> > ../test/recipes/05-test_mdc2.t ............ ok
matt> > ../test/recipes/05-test_rand.t ............ ok
matt> > ../test/recipes/05-test_rc2.t ............. ok
matt> > ../test/recipes/05-test_rc4.t ............. ok
matt> > ../test/recipes/05-test_rc5.t ............. ok
matt> > ../test/recipes/05-test_rmd.t ............. ok
matt> > ../test/recipes/05-test_sha1.t ............ ok
matt> > ../test/recipes/05-test_sha256.t .......... ok
matt> > ../test/recipes/05-test_sha512.t .......... ok
matt> > ../test/recipes/05-test_wp.t .............. ok
matt> > ../test/recipes/10-test_bn.t .............. ok
matt> > ../test/recipes/10-test_exp.t ............. ok
matt> > ../test/recipes/15-test_dh.t .............. ok
matt> > ../test/recipes/15-test_dsa.t ............. ok
matt> > ../test/recipes/15-test_ec.t .............. ok
matt> > ../test/recipes/15-test_ecdh.t ............ ok
matt> > ../test/recipes/15-test_ecdsa.t ........... ok
matt> > ../test/recipes/15-test_rsa.t ............. ok
matt> > ../test/recipes/20-test_enc.t ............. ok
matt> > ../test/recipes/25-test_crl.t ............. ok
matt> > ../test/recipes/25-test_gen.t ............. ok
matt> > ../test/recipes/25-test_pkcs7.t ........... ok
matt> > ../test/recipes/25-test_req.t ............. ok
matt> > ../test/recipes/25-test_sid.t ............. ok
matt> > ../test/recipes/25-test_verify.t .......... ok
matt> > ../test/recipes/25-test_x509.t ............ ok
matt> > ../test/recipes/30-test_engine.t .......... ok
matt> > ../test/recipes/30-test_evp.t ............. ok
matt> > ../test/recipes/30-test_evp_extra.t ....... ok
matt> > ../test/recipes/30-test_pbelu.t ........... ok
matt> > ../test/recipes/40-test_rehash.t .......... ok
matt> > ../test/recipes/70-test_clienthello.t ..... ok
matt> > ../test/recipes/70-test_packet.t .......... ok
matt> > Use of uninitialized value within %message_type in concatenation (.) or
matt> > string at ../util/TLSProxy/Message.pm line 202, <> line 751.
matt> > Changed peer, but we still have fragment data
matt> > # Looks like your test exited with 255 before it could output anything.
matt> > ../test/recipes/70-test_sslextension.t .... 
matt> > Dubious, test returned 255 (wstat 65280, 0xff00)
matt> > Failed 1/1 subtests 
matt> > Use of uninitialized value within %message_type in concatenation (.) or
matt> > string at ../util/TLSProxy/Message.pm line 202, <> line 751.
matt> > Changed peer, but we still have fragment data
matt> > # Looks like your test exited with 255 before it could output anything.
matt> > ../test/recipes/70-test_sslsessiontick.t .. 
matt> > Dubious, test returned 255 (wstat 65280, 0xff00)
matt> > Failed 5/5 subtests 
matt> > ../test/recipes/70-test_sslskewith0p.t .... ok
matt> > Use of uninitialized value within %message_type in concatenation (.) or
matt> > string at ../util/TLSProxy/Message.pm line 202, <> line 751.
matt> > Changed peer, but we still have fragment data
matt> > # Looks like your test exited with 255 before it could output anything.
matt> > ../test/recipes/70-test_sslvertol.t ....... 
matt> > Dubious, test returned 255 (wstat 65280, 0xff00)
matt> > Failed 2/2 subtests 
matt> > ../test/recipes/70-test_verify_extra.t .... ok
matt> > ../test/recipes/80-test_ca.t .............. ok
matt> >     # Looks like you planned 11 tests but ran 20.
matt> > 
matt> > #   Failed test 'CMS <=> CMS consistency tests, modified key parameters
matt> > # '
matt> > #   at ../test/recipes/80-test_cms.t line 460.
matt> > # Looks like you failed 1 test of 4.
matt> > ../test/recipes/80-test_cms.t ............. 
matt> > Dubious, test returned 1 (wstat 256, 0x100)
matt> > Failed 1/4 subtests 
matt> > ../test/recipes/80-test_ocsp.t ............ ok
matt> > ../test/recipes/80-test_ssl.t ............. ok
matt> > ../test/recipes/80-test_tsa.t ............. ok
matt> > ../test/recipes/90-test_constant_time.t ... ok
matt> > ../test/recipes/90-test_gmdiff.t .......... ok
matt> > ../test/recipes/90-test_gost2814789.t ..... ok
matt> > ../test/recipes/90-test_heartbeat.t ....... ok
matt> > ../test/recipes/90-test_ige.t ............. ok
matt> > ../test/recipes/90-test_jpake.t ........... ok
matt> > ../test/recipes/90-test_np.t .............. ok
matt> > ../test/recipes/90-test_p5_crpt2.t ........ ok
matt> > ../test/recipes/90-test_secmem.t .......... ok
matt> > ../test/recipes/90-test_srp.t ............. ok
matt> > ../test/recipes/90-test_v3name.t .......... ok
matt> > 
matt> > Test Summary Report
matt> > -------------------
matt> > ../test/recipes/70-test_sslextension.t  (Wstat: 65280 Tests: 0 Failed: 0)
matt> >   Non-zero exit status: 255
matt> >   Parse errors: Bad plan.  You planned 1 tests but ran 0.
matt> > ../test/recipes/70-test_sslsessiontick.t (Wstat: 65280 Tests: 0 Failed: 0)
matt> >   Non-zero exit status: 255
matt> >   Parse errors: Bad plan.  You planned 5 tests but ran 0.
matt> > ../test/recipes/70-test_sslvertol.t     (Wstat: 65280 Tests: 0 Failed: 0)
matt> >   Non-zero exit status: 255
matt> >   Parse errors: Bad plan.  You planned 2 tests but ran 0.
matt> > ../test/recipes/80-test_cms.t           (Wstat: 256 Tests: 4 Failed: 1)
matt> >   Failed test:  4
matt> >   Non-zero exit status: 1
matt> > Files=63, Tests=324, 27 wallclock secs ( 0.32 usr  0.05 sys + 18.40 cusr
matt> >  8.32 csys = 27.09 CPU)
matt> > Result: FAIL
matt> > Failed 4/63 test programs. 1/324 subtests failed.
matt> > make[1]: *** [tests] Error 255
matt> > make[1]: Leaving directory `/media/uri/Src/openssl/test'
matt> > make: *** [tests] Error 2
matt> > $ gcc -v
matt> > Using built-in specs.
matt> > COLLECT_GCC=gcc
matt> > COLLECT_LTO_WRAPPER=/usr/lib/gcc/x86_64-linux-gnu/4.8/lto-wrapper
matt> > Target: x86_64-linux-gnu
matt> > Configured with: ../src/configure -v --with-pkgversion='Ubuntu
matt> > 4.8.4-2ubuntu1~14.04'
matt> > --with-bugurl=file:///usr/share/doc/gcc-4.8/README.Bugs
matt> > --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --prefix=/usr
matt> > --program-suffix=-4.8 --enable-shared --enable-linker-build-id
matt> > --libexecdir=/usr/lib --without-included-gettext --enable-threads=posix
matt> > --with-gxx-include-dir=/usr/include/c++/4.8 --libdir=/usr/lib
matt> > --enable-nls --with-sysroot=/ --enable-clocale=gnu
matt> > --enable-libstdcxx-debug --enable-libstdcxx-time=yes
matt> > --enable-gnu-unique-object --disable-libmudflap --enable-plugin
matt> > --with-system-zlib --disable-browser-plugin --enable-java-awt=gtk
matt> > --enable-gtk-cairo
matt> > --with-java-home=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64/jre
matt> > --enable-java-home
matt> > --with-jvm-root-dir=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64
matt> > --with-jvm-jar-dir=/usr/lib/jvm-exports/java-1.5.0-gcj-4.8-amd64
matt> > --with-arch-directory=amd64
matt> > --with-ecj-jar=/usr/share/java/eclipse-ecj.jar --enable-objc-gc
matt> > --enable-multiarch --disable-werror --with-arch-32=i686 --with-abi=m64
matt> > --with-multilib-list=m32,m64,mx32 --with-tune=generic
matt> > --enable-checking=release --build=x86_64-linux-gnu
matt> > --host=x86_64-linux-gnu --target=x86_64-linux-gnu
matt> > Thread model: posix
matt> > gcc version 4.8.4 (Ubuntu 4.8.4-2ubuntu1~14.04)
matt> > -- 
matt> > Regards,
matt> > Uri Blumenthal
matt> > 
matt> > 
matt> > _______________________________________________
matt> > openssl-dev mailing list
matt> > To unsubscribe: https://mta.openssl.org/mailman/listinfo/openssl-dev
matt> > 
matt> _______________________________________________
matt> openssl-dev mailing list
matt> To unsubscribe: https://mta.openssl.org/mailman/listinfo/openssl-dev
-------------- next part --------------
A non-text attachment was scrubbed...
Name: sslextension_debug.patch
Type: text/x-patch
Size: 1118 bytes
Desc: not available
URL: <http://mta.openssl.org/pipermail/openssl-dev/attachments/20150918/45bc475d/attachment-0001.bin>