答复: How run the specific test case //答复: How to run a simple test case

Chenxinping kan.chen at huawei.com
Wed Feb 9 15:40:18 UTC 2022 

Thanks for the  information.
NCONF_load  will failed with “./test/ssl_test ./test-runs/test_ssl_new/17-renegotiate.cnf.default”. As strdup will failed in case of “${ENV::TEST_CERTS_DIR}/*” .
Maybe the ENV should be setted before run the test case.

Error information:
# ERROR: (int) 'NCONF_load(conf, test_get_argument(0), NULL) > 0' failed @ test/ssl_test.c:550
# [0] compared to [0]
# ERROR:  @ test/ssl_test.c:553

发件人: Dr. Matthias St. Pierre [mailto:Matthias.St.Pierre at ncp-e.com]
发送时间: 2022年2月9日 23:31
收件人: Chenxinping <kan.chen at huawei.com>; openssl-users at openssl.org
主题: RE: How run the specific test case //答复: How to run a simple test case

Ah ok, maybe I slightly misunderstood your question. From your transcript below I infer that the testsuite ran the perl script `generate_ssl_tests.pl`, which generated some test files an then ran the binary `ssl_test` as follows:

./test/ssl_test ./test-runs/test_ssl_new/17-renegotiate.cnf.default

If the testfile `./test-runs/test_ssl_new/17-renegotiate.cnf.default` still exists, you should be able to debug the program in gdb with the aid of the `wrap.pl` helper script as follows:

./util/wrap.pl  gdb –args ./test/ssl_test ./test-runs/test_ssl_new/17-renegotiate.cnf.default


Hope that helps,

Matthias





[NCP engingeering GmbH]

Dr. Matthias St. Pierre

Tech Lead Cryptography
matthias.st.pierre at ncp-e.com<mailto:matthias.st.pierre at ncp-e.com>
Phone: +49 911 9968-0
www.ncp-e.com<http://www.ncp-e.com>


Follow us on:
 Facebook<https://www.facebook.com/NCPengineering> | Twitter<https://twitter.com/NCP_engineering> | Xing<https://www.xing.com/companies/ncpengineeringgmbh> | YouTube<https://www.youtube.com/user/NCPengineeringGmbH> | LinkedIn<http://www.linkedin.com/company/ncp-engineering-inc.?trk=cws-cpw-coname-0-0>

Headquarters Germany: NCP engineering GmbH • Dombuehler Str. 2 • 90449 • Nuremberg
North American HQ: NCP engineering Inc. • 601 Cleveland Str., Suite 501-25 • Clearwater, FL 33755

Authorized representatives: Peter Soell, Patrick Oliver Graf, Beate Dietrich
Registry Court: Lower District Court of Nuremberg
Commercial register No.: HRB 7786 Nuremberg, VAT identification No.: DE 133557619

This e-mail message including any attachments is for the sole use of the intended recipient(s) and may contain privileged or confidential information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please immediately contact the sender by reply e-mail and delete the original message and destroy all copies thereof.



From: Chenxinping <kan.chen at huawei.com<mailto:kan.chen at huawei.com>>
Sent: Wednesday, February 9, 2022 4:10 PM
To: Dr. Matthias St. Pierre <Matthias.St.Pierre at ncp-e.com<mailto:Matthias.St.Pierre at ncp-e.com>>; openssl-users at openssl.org<mailto:openssl-users at openssl.org>
Subject: How run the specific test case //答复: How to run a simple test case

Thanks for your information,  simple test case means some specific test case.
Some  error reported from some specific test case  in case of “make V=1 TESTS='test_ssl_new*' test”, the error information could not help to local the issue, So I need run and debug the specific test case.

Error information:
../../util/wrap.pl /usr/bin/perl -I ../../util/perl ../../test/generate_ssl_tests.pl ../../test/ssl-tests/17-renegotiate.cnf.in none > 17-renegotiate.cnf.none => 0
    ok 1 - Getting output from generate_ssl_tests.pl.
    ok 2 - Comparing generated 17-renegotiate.cnf.none with ../../test/ssl-tests/17-renegotiate.cnf.
        # Subtest: ../../test/ssl_test
        1..1
            # Subtest: test_handshake
            1..17
            ok 1 - iteration 1
            ok 2 - iteration 2
            ok 3 - iteration 3
            ok 4 - iteration 4
            ok 5 - iteration 5
            ok 6 - iteration 6
            ok 7 - iteration 7
            ok 8 - iteration 8
            ok 9 - iteration 9
            ok 10 - iteration 10
            ok 11 - iteration 11
            # ERROR: (int) 'peer->status == PEER_RETRY' failed @ test/helpers/handshake.c:868
            # [2] compared to [1]
            # ERROR: (int) 'result->result == test_ctx->expected_result' failed @ test/ssl_test.c:36
            # [3] compared to [1]
            # INFO:  @ test/ssl_test.c:37
            # ExpectedResult mismatch: expected ServerFail, got InternalError.
            # OPENSSL_TEST_RAND_ORDER=1644408281
            not ok 12 - iteration 12
            ok 13 - iteration 13
            # ERROR: (int) 'peer->status == PEER_RETRY' failed @ test/helpers/handshake.c:868
            # [2] compared to [1]
            # ERROR: (int) 'result->result == test_ctx->expected_result' failed @ test/ssl_test.c:36
            # [3] compared to [2]
            # INFO:  @ test/ssl_test.c:37
            # ExpectedResult mismatch: expected ClientFail, got InternalError.
            # OPENSSL_TEST_RAND_ORDER=1644408281
            not ok 14 - iteration 14
            # ERROR: (int) 'result->server_alert_sent == result->server_alert_received' failed @ test/ssl_test.c:66
            # [552] compared to [0]
            # INFO:  @ test/ssl_test.c:68
            # Server sent alert handshake failure but client received no alert.
            ok 15 - iteration 15
            ok 16 - iteration 16
            ok 17 - iteration 17
        # OPENSSL_TEST_RAND_ORDER=1644408281
        not ok 1 - test_handshake


发件人: Dr. Matthias St. Pierre [mailto:Matthias.St.Pierre at ncp-e.com]
发送时间: 2022年2月9日 19:31
收件人: Chenxinping <kan.chen at huawei.com<mailto:kan.chen at huawei.com>>; openssl-users at openssl.org<mailto:openssl-users at openssl.org>
主题: RE: How to run a simple test case

The README file in the test directory contains a detailed explanation.

https://github.com/openssl/openssl/blob/master/test/README.md

In a nutshell, you run `make test`, passing  `V=1` to turn on verbose output and `TESTS=…` to select one or more tests:

make V=1  TESTS=<pattern>  test


HTH,
Matthias






[NCP engingeering GmbH]

Dr. Matthias St. Pierre

Tech Lead Cryptography
matthias.st.pierre at ncp-e.com<mailto:matthias.st.pierre at ncp-e.com>
Phone: +49 911 9968-0
www.ncp-e.com<http://www.ncp-e.com>


Follow us on:
 Facebook<https://www.facebook.com/NCPengineering> | Twitter<https://twitter.com/NCP_engineering> | Xing<https://www.xing.com/companies/ncpengineeringgmbh> | YouTube<https://www.youtube.com/user/NCPengineeringGmbH> | LinkedIn<http://www.linkedin.com/company/ncp-engineering-inc.?trk=cws-cpw-coname-0-0>

Headquarters Germany: NCP engineering GmbH • Dombuehler Str. 2 • 90449 • Nuremberg
North American HQ: NCP engineering Inc. • 601 Cleveland Str., Suite 501-25 • Clearwater, FL 33755

Authorized representatives: Peter Soell, Patrick Oliver Graf, Beate Dietrich
Registry Court: Lower District Court of Nuremberg
Commercial register No.: HRB 7786 Nuremberg, VAT identification No.: DE 133557619

This e-mail message including any attachments is for the sole use of the intended recipient(s) and may contain privileged or confidential information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please immediately contact the sender by reply e-mail and delete the original message and destroy all copies thereof.



From: openssl-users <openssl-users-bounces at openssl.org<mailto:openssl-users-bounces at openssl.org>> On Behalf Of Chenxinping via openssl-users
Sent: Wednesday, February 9, 2022 4:49 AM
To: openssl-users at openssl.org<mailto:openssl-users at openssl.org>
Subject: How to run a simple test case

The config file have some ENV variable and will result fail to load the config file, How to run a simple test case?
Example:
./test/ssl_test ./test-runs/test_ssl_new/17-renegotiate.cnf.default
ERROR:  @ test/ssl_test.c:553
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://mta.openssl.org/pipermail/openssl-users/attachments/20220209/a602084d/attachment-0001.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.png
Type: image/png
Size: 10138 bytes
Desc: image001.png
URL: <https://mta.openssl.org/pipermail/openssl-users/attachments/20220209/a602084d/attachment-0001.png>

More information about the openssl-users mailing list