<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<style type="text/css" style="display:none;"><!-- P {margin-top:0;margin-bottom:0;} --></style>
</head>
<body dir="ltr">
<div id="divtagdefaultwrapper" style="font-size:12pt;color:#000000;font-family:Calibri,Helvetica,sans-serif;" dir="ltr">
<p></p>
<div>
<p>I am trying to develop a engine for a custom RSA hardware accelerator, and have a few questions about the RSA_METHOD stucture implementation. </p>
<p><br>
</p>
<p><span>Some context: for encryption, my accelerator takes as inputs the base, public exponent, and modulus, and returns the resulting ciphertext. For decryption, it takes as inputs the base, and modulus. It does not need a private key, as this is stored in
hardware, and can only be configured through an out-of-band channel. I already have a kernel module that exposes an API to userspace programs to use the accelerator. Now I just need to integrate it into openSSL.</span></p>
<p><br>
</p>
<p><span>I've already created a similar engine for AES and SHA256, however I'm struggling with RSA. Ideally, I'd like to not have to worry about anything other than just performing the modular exponentiation on a pre-padded and prepared chunk of data. For SHA
and AES, this is straightforward: all that was taken care of by the EVP interface, so all I needed to worry about was getting the data two and from my accelerators. But it doesn't appear to be as simple for RSA (pls correct me if I'm wrong).</span><br>
</p>
<p><br>
</p>
<p>I'm confused as to which RSA_METHOD function pointers that my engine needs to implement. I show the structure below for reference:</p>
<div><span style="font-family: "Courier New",monospace,serif,"EmojiFont"; font-size: 10pt;">struct rsa_meth_st {</span><br>
<span style="font-family: "Courier New",monospace,serif,"EmojiFont"; font-size: 10pt;"> char *name;</span><br>
<span style="font-family: "Courier New",monospace,serif,"EmojiFont"; font-size: 10pt;"> int (*rsa_pub_enc) (int flen, const unsigned char *from,</span><br>
<span style="font-family: "Courier New",monospace,serif,"EmojiFont"; font-size: 10pt;"> unsigned char *to, RSA *rsa, int padding);</span><br>
<span style="font-family: "Courier New",monospace,serif,"EmojiFont"; font-size: 10pt;"> int (*rsa_pub_dec) (int flen, const unsigned char *from,</span><br>
<span style="font-family: "Courier New",monospace,serif,"EmojiFont"; font-size: 10pt;"> unsigned char *to, RSA *rsa, int padding);</span><br>
<span style="font-family: "Courier New",monospace,serif,"EmojiFont"; font-size: 10pt;"> int (*rsa_priv_enc) (int flen, const unsigned char *from,</span><br>
<span style="font-family: "Courier New",monospace,serif,"EmojiFont"; font-size: 10pt;"> unsigned char *to, RSA *rsa, int padding);</span><br>
<span style="font-family: "Courier New",monospace,serif,"EmojiFont"; font-size: 10pt;"> int (*rsa_priv_dec) (int flen, const unsigned char *from,</span><br>
<span style="font-family: "Courier New",monospace,serif,"EmojiFont"; font-size: 10pt;"> unsigned char *to, RSA *rsa, int padding);</span><br>
<br>
<span style="font-family: "Courier New",monospace,serif,"EmojiFont"; font-size: 10pt;"> int (*rsa_mod_exp) (BIGNUM *r0, const BIGNUM *I, RSA *rsa, BN_CTX *ctx);</span><br>
<br>
<span style="font-family: "Courier New",monospace,serif,"EmojiFont"; font-size: 10pt;"> int (*bn_mod_exp) (BIGNUM *r, const BIGNUM *a, const BIGNUM *p,</span><br>
<span style="font-family: "Courier New",monospace,serif,"EmojiFont"; font-size: 10pt;"> const BIGNUM *m, BN_CTX *ctx, BN_MONT_CTX *m_ctx);</span><br>
<span style="font-family: "Courier New",monospace,serif,"EmojiFont"; font-size: 10pt;"> /* ....stuff.... */</span><br>
<span style="font-family: "Courier New",monospace,serif,"EmojiFont"; font-size: 10pt;"> int flags;</span><br>
<span style="font-family: "Courier New",monospace,serif,"EmojiFont"; font-size: 10pt;"> /* .... stuff ... */</span><br>
<span style="font-family: "Courier New",monospace,serif,"EmojiFont"; font-size: 10pt;">}; // TYPEDEF'ED TO RSA_METHOD in include/ossl_typ.h</span></div>
<p><br>
</p>
<p><b>So, three questions: <br>
</b></p>
<p><b><br>
</b></p>
<ol style="margin-bottom:0px; margin-top:0px">
<li><b>Is it possible for the standard OpenSSL RSA implementation to use my engine's "modular exponentiation" function, without having to rewrite the RSA_[public|private]_[encrypt|decrypt] family of functions from
<span>/include/openssl/rsa.h</span>? <br>
</b></li><li><b>If so, does it suffice to only implement the rsa_mod_exp function? </b>Or must I implement both public_enc/dec and private_enc/dec functions as well? I ask, because the source code for the old Intel RSAX engine (<a href="https://gist.github.com/bigbrett/91903f773f9d150b7329c7d462cd220a" target="_blank" rel="noopener noreferrer" class="x_OWAAutoLink" id="LPlnk486837" previewremoved="true">https://gist.github.com/bigbrett/91903f773f9d150b7329c7d462cd220a</a>)
does this, but I can't figure out how and when in the "RSA flow" the engine's function gets invoked.</li><li>In <span>/include/openssl/rsa.h</span>, I saw the following macro for the RSA_METHOD flag field (line 55):
<br>
</li></ol>
<div><span style="font-family: "Courier New",monospace,serif,"EmojiFont"; font-size: 10pt;">/*</span><br>
<span style="font-family: "Courier New",monospace,serif,"EmojiFont"; font-size: 10pt;"> * This flag means the private key operations will be handled by rsa_mod_exp</span><br>
<span style="font-family: "Courier New",monospace,serif,"EmojiFont"; font-size: 10pt;"> * and that they do not depend on the private key components being present:</span><br>
<span style="font-family: "Courier New",monospace,serif,"EmojiFont"; font-size: 10pt;"> * for example a key stored in external hardware. Without this flag</span><br>
<span style="font-family: "Courier New",monospace,serif,"EmojiFont"; font-size: 10pt;"> * bn_mod_exp gets called when private key components are absent.</span><br>
<span style="font-family: "Courier New",monospace,serif,"EmojiFont"; font-size: 10pt;"> */</span><br>
<span style="font-family: "Courier New",monospace,serif,"EmojiFont"; font-size: 10pt;"># define RSA_FLAG_EXT_PKEY 0x0020</span><br>
<br>
</div>
<p><b>Does this mean that if I use this flag in the "flags" field of RSA_METHOD, that I DO NOT need to implement rsa_pub_enc/dec and friends?
</b>I guess I'm just confused as to at what point in the RSA encryption/decryption process my engine should be invoked at.
<br>
</p>
<br>
<p>FWIW I'm planning on releasing a comprehensive engine tutorial and some documentation for all this stuff once I finish (will already be written up in my thesis), so I want to make sure I get these details ironed out!<br>
</p>
<div>
<p><br>
</p>
Any words of wisdom would be greatly appreciated. </div>
<br>
<p>Best,</p>
<p>Brett<br>
</p>
</div>
<br>
<p></p>
</div>
</body>
</html>