[openssl-dev] master failing unit tests inconsistently?

[Short, Todd]

Hi openssl-dev:

I’ve been running the master branch and have been noticing inconsistant unit tests results. It is failing on a number of tests, and has been for several days. I’m using clang-3.6 (3.6.0-2ubuntu1~trust1) or gcc (4.84-2ubuntu1~14.04.01) on Linux 3.13-0-85-generic #129-Ubuntu.

This is one sample:

../test/recipes/70-test_sslcertstatus.t .... Failed 1/1 subtests
../test/recipes/70-test_sslextension.t ..... Failed 2/3 subtests
../test/recipes/70-test_sslsessiontick.t ... Failed 9/10 subtests
../test/recipes/70-test_sslskewith0p.t ..... (hangs)

OR

Test Summary Report
-------------------
../test/recipes/70-test_sslextension.t   (Wstat: 13 Tests: 2 Failed: 0)
  Non-zero wait status: 13
  Parse errors: Bad plan.  You planned 3 tests but ran 2.
../test/recipes/70-test_sslsessiontick.t (Wstat: 13 Tests: 1 Failed: 0)
  Non-zero wait status: 13
  Parse errors: Bad plan.  You planned 8 tests but ran 1.
../test/recipes/70-test_sslvertol.t      (Wstat: 13 Tests: 0 Failed: 0)
  Non-zero wait status: 13
  Parse errors: Bad plan.  You planned 2 tests but ran 0.
../test/recipes/70-test_tlsextms.t       (Wstat: 13 Tests: 1 Failed: 0)
  Non-zero wait status: 13
  Parse errors: Bad plan.  You planned 9 tests but ran 1.
Files=78, Tests=417, 107 wallclock secs ( 0.65 usr  0.08 sys + 93.02 cusr 14.76 csys = 108.51 CPU)
Result: FAIL
Failed 4/78 test programs. 0/417 subtests failed.
make: *** [tests] Error 255

Is anyone else seeing this?

It seems related to https://github.com/openssl/openssl/commit/7ad5fb6267e9da1634998bf2eccaa753f443fa83

--
-Todd Short
// tshort at akamai.com<mailto:tshort at akamai.com>
// "One if by land, two if by sea, three if by the Internet."

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mta.openssl.org/pipermail/openssl-dev/attachments/20160516/41fc039d/attachment.html>