[openssl-dev] master failing unit tests inconsistently?

[Matt Caswell]

On 16/05/16 15:57, Matt Caswell wrote:
> Yes, its a known issue. No fix as yet.

Hopefully 6ae5452481 has fixed the issue.

Matt


> 
> Matt
> 
> On 16/05/16 15:49, Short, Todd wrote:
>> Hi openssl-dev:
>>
>> I’ve been running the master branch and have been noticing inconsistant
>> unit tests results. It is failing on a number of tests, and has been for
>> several days. I’m using clang-3.6 (3.6.0-2ubuntu1~trust1) or gcc
>> (4.84-2ubuntu1~14.04.01) on Linux 3.13-0-85-generic #129-Ubuntu.
>>
>> This is one sample:
>>
>> ../test/recipes/70-test_sslcertstatus.t .... Failed 1/1 subtests 
>> ../test/recipes/70-test_sslextension.t ..... Failed 2/3 subtests 
>> ../test/recipes/70-test_sslsessiontick.t ... Failed 9/10 subtests 
>> ../test/recipes/70-test_sslskewith0p.t ..... (hangs)
>>
>> OR
>>
>> Test Summary Report
>> -------------------
>> ../test/recipes/70-test_sslextension.t   (Wstat: 13 Tests: 2 Failed: 0)
>>   Non-zero wait status: 13
>>   Parse errors: Bad plan.  You planned 3 tests but ran 2.
>> ../test/recipes/70-test_sslsessiontick.t (Wstat: 13 Tests: 1 Failed: 0)
>>   Non-zero wait status: 13
>>   Parse errors: Bad plan.  You planned 8 tests but ran 1.
>> ../test/recipes/70-test_sslvertol.t      (Wstat: 13 Tests: 0 Failed: 0)
>>   Non-zero wait status: 13
>>   Parse errors: Bad plan.  You planned 2 tests but ran 0.
>> ../test/recipes/70-test_tlsextms.t       (Wstat: 13 Tests: 1 Failed: 0)
>>   Non-zero wait status: 13
>>   Parse errors: Bad plan.  You planned 9 tests but ran 1.
>> Files=78, Tests=417, 107 wallclock secs ( 0.65 usr  0.08 sys + 93.02
>> cusr 14.76 csys = 108.51 CPU)
>> Result: FAIL
>> Failed 4/78 test programs. 0/417 subtests failed.
>> make: *** [tests] Error 255
>>
>> Is anyone else seeing this?
>>
>> It seems related
>> to https://github.com/openssl/openssl/commit/7ad5fb6267e9da1634998bf2eccaa753f443fa83
>>
>> --
>> -Todd Short
>> // tshort at akamai.com <mailto:tshort at akamai.com>
>> // "One if by land, two if by sea, three if by the Internet."
>>
>>
>>