[openssl-dev] Some tests fail on the current/latest SNAP

Fri Sep 18 19:23:09 UTC 2015

On 9/18/15, 15:15 , "Richard Levitte" <richard at levitte.org> wrote:

>Did you apply the full patch?  The was a part for
>test/recipes/70-test_sslextension.t that should have had it generate
>debugging output...

Yes I’m sure I did. And I’m as surprised as you are to not see the
expected output from at least “Message.pm”…

In message <D221B126.1F30D%uri at ll.mit.edu> on Fri, 18 Sep 2015 16:18:53
+0000, "Blumenthal, Uri - 0553 - MITLL" <uri at ll.mit.edu> said:
>uri> Richard,
>uri> 
>uri> Thank you for your help! Unfortunately, the problem persists:
>uri> 
>uri> testing...
>uri> make[1]: Entering directory `/media/uri/Src/openssl/test'
>uri> make[2]: Entering directory `/media/uri/Src/openssl'
>uri> making all in apps...
>uri> make[3]: Entering directory `/media/uri/Src/openssl/apps'
>uri> make[3]: Nothing to be done for `all'.
>uri> make[3]: Leaving directory `/media/uri/Src/openssl/apps'
>uri> make[2]: Leaving directory `/media/uri/Src/openssl'
>uri> TOP=.. PERL=/usr/bin/perl /usr/bin/perl run_tests.pl alltests
>uri> ../test/recipes/00-check_testexes.t ....... ok
>uri> ../test/recipes/05-test_bf.t .............. ok
>uri> ../test/recipes/05-test_cast.t ............ ok
>uri> ../test/recipes/05-test_des.t ............. ok
>uri> ../test/recipes/05-test_hmac.t ............ ok
>uri> ../test/recipes/05-test_idea.t ............ ok
>uri> ../test/recipes/05-test_md2.t ............. ok
>uri> ../test/recipes/05-test_md4.t ............. ok
>uri> ../test/recipes/05-test_md5.t ............. ok
>uri> ../test/recipes/05-test_mdc2.t ............ ok
>uri> ../test/recipes/05-test_rand.t ............ ok
>uri> ../test/recipes/05-test_rc2.t ............. ok
>uri> ../test/recipes/05-test_rc4.t ............. ok
>uri> ../test/recipes/05-test_rc5.t ............. ok
>uri> ../test/recipes/05-test_rmd.t ............. ok
>uri> ../test/recipes/05-test_sha1.t ............ ok
>uri> ../test/recipes/05-test_sha256.t .......... ok
>uri> ../test/recipes/05-test_sha512.t .......... ok
>uri> ../test/recipes/05-test_wp.t .............. ok
>uri> ../test/recipes/10-test_bn.t .............. ok
>uri> ../test/recipes/10-test_exp.t ............. ok
>uri> ../test/recipes/15-test_dh.t .............. ok
>uri> ../test/recipes/15-test_dsa.t ............. ok
>uri> ../test/recipes/15-test_ec.t .............. ok
>uri> ../test/recipes/15-test_ecdh.t ............ ok
>uri> ../test/recipes/15-test_ecdsa.t ........... ok
>uri> ../test/recipes/15-test_rsa.t ............. ok
>uri> ../test/recipes/20-test_enc.t ............. ok
>uri> ../test/recipes/25-test_crl.t ............. ok
>uri> ../test/recipes/25-test_gen.t ............. ok
>uri> ../test/recipes/25-test_pkcs7.t ........... ok
>uri> ../test/recipes/25-test_req.t ............. ok
>uri> ../test/recipes/25-test_sid.t ............. ok
>uri> ../test/recipes/25-test_verify.t .......... ok
>uri> ../test/recipes/25-test_x509.t ............ ok
>uri> ../test/recipes/30-test_engine.t .......... ok
>uri> ../test/recipes/30-test_evp.t ............. ok
>uri> ../test/recipes/30-test_evp_extra.t ....... ok
>uri> ../test/recipes/30-test_pbelu.t ........... ok
>uri> ../test/recipes/40-test_rehash.t .......... ok
>uri> ../test/recipes/70-test_clienthello.t ..... ok
>uri> ../test/recipes/70-test_packet.t .......... ok
>uri> Use of uninitialized value within %message_type in concatenation (.)
>or
>uri> string at ../util/TLSProxy/Message.pm line 202, <> line 751.
>uri> Changed peer, but we still have fragment data
>uri> # Looks like your test exited with 255 before it could output
>anything.
>uri> ../test/recipes/70-test_sslextension.t ....
>uri> Dubious, test returned 255 (wstat 65280, 0xff00)
>uri> Failed 1/1 subtests
>uri> Use of uninitialized value within %message_type in concatenation (.)
>or
>uri> string at ../util/TLSProxy/Message.pm line 202, <> line 751.
>uri> Changed peer, but we still have fragment data
>uri> # Looks like your test exited with 255 before it could output
>anything.
>uri> ../test/recipes/70-test_sslsessiontick.t ..
>uri> Dubious, test returned 255 (wstat 65280, 0xff00)
>uri> Failed 5/5 subtests
>uri> ../test/recipes/70-test_sslskewith0p.t .... ok
>uri> Use of uninitialized value within %message_type in concatenation (.)
>or
>uri> string at ../util/TLSProxy/Message.pm line 202, <> line 751.
>uri> Changed peer, but we still have fragment data
>uri> # Looks like your test exited with 255 before it could output
>anything.
>uri> ../test/recipes/70-test_sslvertol.t .......
>uri> Dubious, test returned 255 (wstat 65280, 0xff00)
>uri> Failed 2/2 subtests
>uri> ../test/recipes/70-test_verify_extra.t .... ok
>uri> ../test/recipes/80-test_ca.t .............. ok
>uri>     # Looks like you planned 11 tests but ran 20.
>uri> 
>uri> #   Failed test 'CMS <=> CMS consistency tests, modified key
>parameters
>uri> # '
>uri> #   at ../test/recipes/80-test_cms.t line 460.
>uri> # Looks like you failed 1 test of 4.
>uri> ../test/recipes/80-test_cms.t .............
>uri> Dubious, test returned 1 (wstat 256, 0x100)
>uri> Failed 1/4 subtests
>uri> ../test/recipes/80-test_ocsp.t ............ ok
>uri> ../test/recipes/80-test_ssl.t ............. ok
>uri> ../test/recipes/80-test_tsa.t ............. ok
>uri> ../test/recipes/90-test_constant_time.t ... ok
>uri> ../test/recipes/90-test_gmdiff.t .......... ok
>uri> ../test/recipes/90-test_gost2814789.t ..... ok
>uri> ../test/recipes/90-test_heartbeat.t ....... ok
>uri> ../test/recipes/90-test_ige.t ............. ok
>uri> ../test/recipes/90-test_jpake.t ........... ok
>uri> ../test/recipes/90-test_np.t .............. ok
>uri> ../test/recipes/90-test_p5_crpt2.t ........ ok
>uri> ../test/recipes/90-test_secmem.t .......... ok
>uri> ../test/recipes/90-test_srp.t ............. ok
>uri> ../test/recipes/90-test_v3name.t .......... ok
>uri> 
>uri> Test Summary Report
>uri> -------------------
>uri> ../test/recipes/70-test_sslextension.t  (Wstat: 65280 Tests: 0
>Failed: 0)
>uri>   Non-zero exit status: 255
>uri>   Parse errors: Bad plan.  You planned 1 tests but ran 0.
>uri> ../test/recipes/70-test_sslsessiontick.t (Wstat: 65280 Tests: 0
>Failed: 0)
>uri>   Non-zero exit status: 255
>uri>   Parse errors: Bad plan.  You planned 5 tests but ran 0.
>uri> ../test/recipes/70-test_sslvertol.t     (Wstat: 65280 Tests: 0
>Failed: 0)
>uri>   Non-zero exit status: 255
>uri>   Parse errors: Bad plan.  You planned 2 tests but ran 0.
>uri> ../test/recipes/80-test_cms.t           (Wstat: 256 Tests: 4 Failed:
>1)
>uri>   Failed test:  4
>uri>   Non-zero exit status: 1
>uri> Files=63, Tests=324, 30 wallclock secs ( 0.31 usr  0.08 sys + 19.13
>cusr
>uri> 8.61 csys = 28.13 CPU)
>uri> Result: FAIL
>uri> Failed 4/63 test programs. 1/324 subtests failed.
>uri> make[1]: *** [tests] Error 255
>uri> make[1]: Leaving directory `/media/uri/Src/openssl/test'
>uri> make: *** [tests] Error 2
>uri> 
>uri> 
>uri> 
>uri> What can we (I :) do to either remedy it, or provide you more info
>to find
>uri> the cause?
>uri> -- 
>uri> Regards,
>uri> Uri Blumenthal
>uri> 
>uri> 
>uri> 
>uri> 
>uri> 
>uri> On 9/18/15, 2:27 , "Richard Levitte" <richard at levitte.org> wrote:
>uri> 
>uri> >I can't reproduce it either, but judging from the line number, it
>uri> >looks like a surprise unknown message type.  Uri, the attached patch
>uri> >and the following command line might help clear this up:
>uri> >
>uri> >    HARNESS_VERBOSE=yes make TESTS=test_sslextension test
>uri> >
>uri> >Cheers,
>uri> >Richard
>uri> >
>uri> >In message <55FB36B5.40105 at openssl.org> on Thu, 17 Sep 2015 22:55:01
>uri> >+0100, Matt Caswell <matt at openssl.org> said:
>uri> >
>uri> >matt> Hmmm. I cannot reproduce this. Is anyone else seeing this?
>uri> >matt> 
>uri> >matt> Matt
>uri> >matt> 
>uri> >matt> On 17/09/15 20:15, Blumenthal, Uri - 0553 - MITLL wrote:
>uri> >matt> > $ apps/openssl$ openssl version
>uri> >matt> > OpenSSL 1.1.0-dev xx XXX xxxx
>uri> >matt> > $ make test
>uri> >matt> > testing...
>uri> >matt> > make[1]: Entering directory `/media/uri/Src/openssl/test'
>uri> >matt> > make[2]: Entering directory `/media/uri/Src/openssl'
>uri> >matt> > making all in apps...
>uri> >matt> > make[3]: Entering directory `/media/uri/Src/openssl/apps'
>uri> >matt> > make[3]: Nothing to be done for `all'.
>uri> >matt> > make[3]: Leaving directory `/media/uri/Src/openssl/apps'
>uri> >matt> > make[2]: Leaving directory `/media/uri/Src/openssl'
>uri> >matt> > TOP=.. PERL=/usr/bin/perl /usr/bin/perl run_tests.pl
>alltests
>uri> >matt> > ../test/recipes/00-check_testexes.t ....... ok
>uri> >matt> > ../test/recipes/05-test_bf.t .............. ok
>uri> >matt> > ../test/recipes/05-test_cast.t ............ ok
>uri> >matt> > ../test/recipes/05-test_des.t ............. ok
>uri> >matt> > ../test/recipes/05-test_hmac.t ............ ok
>uri> >matt> > ../test/recipes/05-test_idea.t ............ ok
>uri> >matt> > ../test/recipes/05-test_md2.t ............. ok
>uri> >matt> > ../test/recipes/05-test_md4.t ............. ok
>uri> >matt> > ../test/recipes/05-test_md5.t ............. ok
>uri> >matt> > ../test/recipes/05-test_mdc2.t ............ ok
>uri> >matt> > ../test/recipes/05-test_rand.t ............ ok
>uri> >matt> > ../test/recipes/05-test_rc2.t ............. ok
>uri> >matt> > ../test/recipes/05-test_rc4.t ............. ok
>uri> >matt> > ../test/recipes/05-test_rc5.t ............. ok
>uri> >matt> > ../test/recipes/05-test_rmd.t ............. ok
>uri> >matt> > ../test/recipes/05-test_sha1.t ............ ok
>uri> >matt> > ../test/recipes/05-test_sha256.t .......... ok
>uri> >matt> > ../test/recipes/05-test_sha512.t .......... ok
>uri> >matt> > ../test/recipes/05-test_wp.t .............. ok
>uri> >matt> > ../test/recipes/10-test_bn.t .............. ok
>uri> >matt> > ../test/recipes/10-test_exp.t ............. ok
>uri> >matt> > ../test/recipes/15-test_dh.t .............. ok
>uri> >matt> > ../test/recipes/15-test_dsa.t ............. ok
>uri> >matt> > ../test/recipes/15-test_ec.t .............. ok
>uri> >matt> > ../test/recipes/15-test_ecdh.t ............ ok
>uri> >matt> > ../test/recipes/15-test_ecdsa.t ........... ok
>uri> >matt> > ../test/recipes/15-test_rsa.t ............. ok
>uri> >matt> > ../test/recipes/20-test_enc.t ............. ok
>uri> >matt> > ../test/recipes/25-test_crl.t ............. ok
>uri> >matt> > ../test/recipes/25-test_gen.t ............. ok
>uri> >matt> > ../test/recipes/25-test_pkcs7.t ........... ok
>uri> >matt> > ../test/recipes/25-test_req.t ............. ok
>uri> >matt> > ../test/recipes/25-test_sid.t ............. ok
>uri> >matt> > ../test/recipes/25-test_verify.t .......... ok
>uri> >matt> > ../test/recipes/25-test_x509.t ............ ok
>uri> >matt> > ../test/recipes/30-test_engine.t .......... ok
>uri> >matt> > ../test/recipes/30-test_evp.t ............. ok
>uri> >matt> > ../test/recipes/30-test_evp_extra.t ....... ok
>uri> >matt> > ../test/recipes/30-test_pbelu.t ........... ok
>uri> >matt> > ../test/recipes/40-test_rehash.t .......... ok
>uri> >matt> > ../test/recipes/70-test_clienthello.t ..... ok
>uri> >matt> > ../test/recipes/70-test_packet.t .......... ok
>uri> >matt> > Use of uninitialized value within %message_type in
>concatenation
>uri> >(.) or
>uri> >matt> > string at ../util/TLSProxy/Message.pm line 202, <> line 751.
>uri> >matt> > Changed peer, but we still have fragment data
>uri> >matt> > # Looks like your test exited with 255 before it could
>output
>uri> >anything.
>uri> >matt> > ../test/recipes/70-test_sslextension.t ....
>uri> >matt> > Dubious, test returned 255 (wstat 65280, 0xff00)
>uri> >matt> > Failed 1/1 subtests
>uri> >matt> > Use of uninitialized value within %message_type in
>concatenation
>uri> >(.) or
>uri> >matt> > string at ../util/TLSProxy/Message.pm line 202, <> line 751.
>uri> >matt> > Changed peer, but we still have fragment data
>uri> >matt> > # Looks like your test exited with 255 before it could
>output
>uri> >anything.
>uri> >matt> > ../test/recipes/70-test_sslsessiontick.t ..
>uri> >matt> > Dubious, test returned 255 (wstat 65280, 0xff00)
>uri> >matt> > Failed 5/5 subtests
>uri> >matt> > ../test/recipes/70-test_sslskewith0p.t .... ok
>uri> >matt> > Use of uninitialized value within %message_type in
>concatenation
>uri> >(.) or
>uri> >matt> > string at ../util/TLSProxy/Message.pm line 202, <> line 751.
>uri> >matt> > Changed peer, but we still have fragment data
>uri> >matt> > # Looks like your test exited with 255 before it could
>output
>uri> >anything.
>uri> >matt> > ../test/recipes/70-test_sslvertol.t .......
>uri> >matt> > Dubious, test returned 255 (wstat 65280, 0xff00)
>uri> >matt> > Failed 2/2 subtests
>uri> >matt> > ../test/recipes/70-test_verify_extra.t .... ok
>uri> >matt> > ../test/recipes/80-test_ca.t .............. ok
>uri> >matt> >     # Looks like you planned 11 tests but ran 20.
>uri> >matt> > 
>uri> >matt> > #   Failed test 'CMS <=> CMS consistency tests, modified key
>uri> >parameters
>uri> >matt> > # '
>uri> >matt> > #   at ../test/recipes/80-test_cms.t line 460.
>uri> >matt> > # Looks like you failed 1 test of 4.
>uri> >matt> > ../test/recipes/80-test_cms.t .............
>uri> >matt> > Dubious, test returned 1 (wstat 256, 0x100)
>uri> >matt> > Failed 1/4 subtests
>uri> >matt> > ../test/recipes/80-test_ocsp.t ............ ok
>uri> >matt> > ../test/recipes/80-test_ssl.t ............. ok
>uri> >matt> > ../test/recipes/80-test_tsa.t ............. ok
>uri> >matt> > ../test/recipes/90-test_constant_time.t ... ok
>uri> >matt> > ../test/recipes/90-test_gmdiff.t .......... ok
>uri> >matt> > ../test/recipes/90-test_gost2814789.t ..... ok
>uri> >matt> > ../test/recipes/90-test_heartbeat.t ....... ok
>uri> >matt> > ../test/recipes/90-test_ige.t ............. ok
>uri> >matt> > ../test/recipes/90-test_jpake.t ........... ok
>uri> >matt> > ../test/recipes/90-test_np.t .............. ok
>uri> >matt> > ../test/recipes/90-test_p5_crpt2.t ........ ok
>uri> >matt> > ../test/recipes/90-test_secmem.t .......... ok
>uri> >matt> > ../test/recipes/90-test_srp.t ............. ok
>uri> >matt> > ../test/recipes/90-test_v3name.t .......... ok
>uri> >matt> > 
>uri> >matt> > Test Summary Report
>uri> >matt> > -------------------
>uri> >matt> > ../test/recipes/70-test_sslextension.t  (Wstat: 65280
>Tests: 0
>uri> >Failed: 0)
>uri> >matt> >   Non-zero exit status: 255
>uri> >matt> >   Parse errors: Bad plan.  You planned 1 tests but ran 0.
>uri> >matt> > ../test/recipes/70-test_sslsessiontick.t (Wstat: 65280
>Tests: 0
>uri> >Failed: 0)
>uri> >matt> >   Non-zero exit status: 255
>uri> >matt> >   Parse errors: Bad plan.  You planned 5 tests but ran 0.
>uri> >matt> > ../test/recipes/70-test_sslvertol.t     (Wstat: 65280
>Tests: 0
>uri> >Failed: 0)
>uri> >matt> >   Non-zero exit status: 255
>uri> >matt> >   Parse errors: Bad plan.  You planned 2 tests but ran 0.
>uri> >matt> > ../test/recipes/80-test_cms.t           (Wstat: 256 Tests: 4
>uri> >Failed: 1)
>uri> >matt> >   Failed test:  4
>uri> >matt> >   Non-zero exit status: 1
>uri> >matt> > Files=63, Tests=324, 27 wallclock secs ( 0.32 usr  0.05 sys
>+
>uri> >18.40 cusr
>uri> >matt> >  8.32 csys = 27.09 CPU)
>uri> >matt> > Result: FAIL
>uri> >matt> > Failed 4/63 test programs. 1/324 subtests failed.
>uri> >matt> > make[1]: *** [tests] Error 255
>uri> >matt> > make[1]: Leaving directory `/media/uri/Src/openssl/test'
>uri> >matt> > make: *** [tests] Error 2
>uri> >matt> > $ gcc -v
>uri> >matt> > Using built-in specs.
>uri> >matt> > COLLECT_GCC=gcc
>uri> >matt> > 
>COLLECT_LTO_WRAPPER=/usr/lib/gcc/x86_64-linux-gnu/4.8/lto-wrapper
>uri> >matt> > Target: x86_64-linux-gnu
>uri> >matt> > Configured with: ../src/configure -v
>--with-pkgversion='Ubuntu
>uri> >matt> > 4.8.4-2ubuntu1~14.04'
>uri> >matt> > --with-bugurl=file:///usr/share/doc/gcc-4.8/README.Bugs
>uri> >matt> > --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++
>uri> >--prefix=/usr
>uri> >matt> > --program-suffix=-4.8 --enable-shared
>--enable-linker-build-id
>uri> >matt> > --libexecdir=/usr/lib --without-included-gettext
>uri> >--enable-threads=posix
>uri> >matt> > --with-gxx-include-dir=/usr/include/c++/4.8
>--libdir=/usr/lib
>uri> >matt> > --enable-nls --with-sysroot=/ --enable-clocale=gnu
>uri> >matt> > --enable-libstdcxx-debug --enable-libstdcxx-time=yes
>uri> >matt> > --enable-gnu-unique-object --disable-libmudflap
>--enable-plugin
>uri> >matt> > --with-system-zlib --disable-browser-plugin
>--enable-java-awt=gtk
>uri> >matt> > --enable-gtk-cairo
>uri> >matt> > --with-java-home=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64/jre
>uri> >matt> > --enable-java-home
>uri> >matt> > --with-jvm-root-dir=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64
>uri> >matt> > 
>--with-jvm-jar-dir=/usr/lib/jvm-exports/java-1.5.0-gcj-4.8-amd64
>uri> >matt> > --with-arch-directory=amd64
>uri> >matt> > --with-ecj-jar=/usr/share/java/eclipse-ecj.jar
>--enable-objc-gc
>uri> >matt> > --enable-multiarch --disable-werror --with-arch-32=i686
>uri> >--with-abi=m64
>uri> >matt> > --with-multilib-list=m32,m64,mx32 --with-tune=generic
>uri> >matt> > --enable-checking=release --build=x86_64-linux-gnu
>uri> >matt> > --host=x86_64-linux-gnu --target=x86_64-linux-gnu
>uri> >matt> > Thread model: posix
>uri> >matt> > gcc version 4.8.4 (Ubuntu 4.8.4-2ubuntu1~14.04)
>uri> >matt> > -- 
>uri> >matt> > Regards,
>uri> >matt> > Uri Blumenthal
>uri> >matt> > 
>uri> >matt> > 
>uri> >matt> > _______________________________________________
>uri> >matt> > openssl-dev mailing list
>uri> >matt> > To unsubscribe:
>uri> >https://mta.openssl.org/mailman/listinfo/openssl-dev
>uri> >matt> > 
>uri> >matt> _______________________________________________
>uri> >matt> openssl-dev mailing list
>uri> >matt> To unsubscribe:
>https://mta.openssl.org/mailman/listinfo/openssl-dev
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 4308 bytes
Desc: not available
URL: <http://mta.openssl.org/pipermail/openssl-dev/attachments/20150918/889903d7/attachment.bin>