[openssl-dev] [openssl.org #4612] Appcrash on SSL_CTX_new(SSLv2_server_method()) on windows 7 x64 with OpenSSL-1.0.1t

[Dmytro Shamatrin via RT]

Appcrash on SSL_CTX_new(SSLv2_server_method()) on windows 7 x64 with OpenSSL-1.0.1t

After upgrade from OpenSSL-1.0.1L version to 1.0.1t we got Appcrash on windows machine. After investigation I found that it started to happen after R version. 

  #include <string.h>
  #include <openssl/bio.h>
  #include <openssl/ssl.h>
  #include <openssl/err.h>
  #include <openssl/pem.h>
  #include <openssl/x509.h>
  #include <openssl/x509_vfy.h>
  #include <openssl/crypto.h>
  #include <openssl/rand.h>
  #include <openssl/pkcs12.h>
  int main()
  {
    unsigned int off = 0;
    SSL_CTX *sslctx;
    OpenSSL_add_all_algorithms();
    SSL_load_error_strings();
    ERR_load_crypto_strings();
    SSL_library_init();
    sslctx = SSL_CTX_new(SSLv2_server_method());
    // Next line causes an issue
    SSL_CTX_set_options(sslctx, 0);
    return 0;
  }

I used following command to compile this program:

cl /I"." ost.c /link out32dll\ssleay32.lib out32dll\libeay32.lib

If you replace ssleay32.dll and libeay32.dll T with dlls from L version, everything will be working fine.

My OpenSSL compiled with VC6. To confirm that issue is not in the compiler, I've compiled openssl with VC10 and got the same issue.

I've configured OpenSSL and built OpenSSL with:
    perl Configure no-asm -DOPENSSL_USE_IPV6=0 VC-WIN32
    ms\do_ms
    nmake -f ms\ntdll.mak
    nmake -f ms\ntdll.mak test
    nmake -f ms\ntdll.mak install

We can't use x64 compiler, because we use perl, which was compiled many years ago with VC6 x86.
I also can provide my binaries, if required.

Thanks.

-- 
Ticket here: http://rt.openssl.org/Ticket/Display.html?id=4612
Please log in as guest with password guest if prompted