<span style='font-family:Verdana'><span style='font-size:12px'>Perhaps we can imagine a pool of intermediate keys (between master keys and object keys) :<br />- 1000 (for example) intermediate keys are stored in the key manager and saved somewhere else, encrypted by a unique master key<br />- Each service can load and store in memory all the intermediate keys from the key manager<br />- Each object is encrypted by an unique object key randomly generated<br />- The object key is encrypted by intermediate key, randomly selected, and is stored with the object as a metadata<br />- The intermediate key id is stored as a metadata with the object<br /><br />My major focuses :<br />- avoid the loss of association object + object key<br />- avoid the SPOF effect of the key manager<br /><br /> <p style="margin:0px; padding:0px;" > </p><blockquote style="border-left: 1px solid rgb(204, 204, 204); padding-left: 5px; margin: 0px 0px 0px 5px;" type="cite"><p style="margin:0px; padding:0px;" ><span style="font-family: Verdana;"><span style="font-size: 12px;">----- Original Message -----</span></span></p><p style="margin:0px; padding:0px;" ><span style="font-family: Verdana;"><span style="font-size: 12px;">From: Bhandaru, Malini K</span></span></p><p style="margin:0px; padding:0px;" ><span style="font-family: Verdana;"><span style="font-size: 12px;">Sent: 03/12/13 07:48 PM</span></span></p><p style="margin:0px; padding:0px;" ><span style="font-family: Verdana;"><span style="font-size: 12px;">To: OpenStack Development Mailing List</span></span></p><p style="margin:0px; padding:0px;" ><span style="font-family: Verdana;"><span style="font-size: 12px;">Subject: Re: [openstack-dev] key manager proposal</span></span></p> <div link="blue" vlink="purple"><div class="WordSection1"><p class="MsoNormal"><span style="font-size: 11pt; font-family: "Calibri","sans-serif"; color: rgb(31, 73, 125);">Yes Paul, it could be stored as you suggest, but the idea behind having a separate key manager is to make things more difficult.</span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoNormal"><span style="font-size: 11pt; font-family: "Calibri","sans-serif"; color: rgb(31, 73, 125);">Say someone stole a disk with a bunch of </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoNormal"><span style="font-size: 11pt; font-family: "Calibri","sans-serif"; color: rgb(31, 73, 125);">Enc-obj-1,  enc(key-1, master-key></span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoNormal"><span style="font-size: 11pt; font-family: "Calibri","sans-serif"; color: rgb(31, 73, 125);">Enc-obj-2, enc(key-2, master-key></span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoNormal"><span style="font-size: 11pt; font-family: "Calibri","sans-serif"; color: rgb(31, 73, 125);">Enc-obj-3, enc(key-3, master-key></span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoNormal"> </p><p style="margin:0px; padding:0px;" ><span style="font-size: 11pt; font-family: "Calibri","sans-serif"; color: rgb(31, 73, 125);"> </span></p><p class="MsoNormal"><span style="font-size: 11pt; font-family: "Calibri","sans-serif"; color: rgb(31, 73, 125);">The moment that master-key is cracked, obj1, 2, 3 become accessible.</span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoNormal"> </p><p style="margin:0px; padding:0px;" ><span style="font-size: 11pt; font-family: "Calibri","sans-serif"; color: rgb(31, 73, 125);"> </span></p><p class="MsoNormal"><span style="font-size: 11pt; font-family: "Calibri","sans-serif"; color: rgb(31, 73, 125);">Object-store/volume-store                              key-manager</span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoNormal"><span style="font-size: 11pt; font-family: "Calibri","sans-serif"; color: rgb(31, 73, 125);">Enc-obj-1,  key-id-1                                            key-id-1:  enc(key-1, master-key></span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoNormal"><span style="font-size: 11pt; font-family: "Calibri","sans-serif"; color: rgb(31, 73, 125);">Enc-obj-2,  key-id-2                                            key-id-2:  enc(key-2, master-key></span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoNormal"><span style="font-size: 11pt; font-family: "Calibri","sans-serif"; color: rgb(31, 73, 125);">Enc-obj-3,  key-id-3                                            key-id-3   enc(key-3, master-key></span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoNormal"> </p><p style="margin:0px; padding:0px;" ><span style="font-size: 11pt; font-family: "Calibri","sans-serif"; color: rgb(31, 73, 125);"> </span></p><p class="MsoNormal"><span style="font-size: 11pt; font-family: "Calibri","sans-serif"; color: rgb(31, 73, 125);">Even with a TPM, the master-key would be saved encrypted in the TPM storage.  Should the object host computer get stolen, and the</span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoNormal"><span style="font-size: 11pt; font-family: "Calibri","sans-serif"; color: rgb(31, 73, 125);">Master-key extracted, the data would still be safe through a chain of actions (disabling access to the key-manager, changing master key, and</span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoNormal"><span style="font-size: 11pt; font-family: "Calibri","sans-serif"; color: rgb(31, 73, 125);">re-encrypting all the key-strings associated with the service with a new master) .</span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoNormal"> </p><p style="margin:0px; padding:0px;" ><span style="font-size: 11pt; font-family: "Calibri","sans-serif"; color: rgb(31, 73, 125);"> </span></p><p class="MsoNormal"><span style="font-size: 11pt; font-family: "Calibri","sans-serif"; color: rgb(31, 73, 125);">On the note of making things harder to crack, one could have another layer of protection, encrypting key-id with a master-key-id …</span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoNormal"> </p><p style="margin:0px; padding:0px;" ><span style="font-size: 11pt; font-family: "Calibri","sans-serif"; color: rgb(31, 73, 125);"> </span></p><p class="MsoNormal"><span style="font-size: 11pt; font-family: "Calibri","sans-serif"; color: rgb(31, 73, 125);">Regards</span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoNormal"><span style="font-size: 11pt; font-family: "Calibri","sans-serif"; color: rgb(31, 73, 125);">Malini</span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoNormal"> </p><p style="margin:0px; padding:0px;" ><span style="font-size: 11pt; font-family: "Calibri","sans-serif"; color: rgb(31, 73, 125);"> </span></p><p class="MsoNormal"><b><span style="font-size: 10pt; font-family: "Tahoma","sans-serif";">From:</span></b><span style="font-size: 10pt; font-family: "Tahoma","sans-serif";"> Paul Sarin-Pollet [mailto:psarpol@gmx.com]<br /><b>Sent:</b> Tuesday, March 12, 2013 3:44 AM<br /><b>To:</b> OpenStack Development Mailing List<br /><b>Subject:</b> Re: [openstack-dev] key manager proposal</span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoNormal"> </p><p style="margin:0px; padding:0px;" > </p><p class="MsoNormal"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";">Hi Malini,<br /><br />Do you agree that instead to store the key-id and the key in a key manager, the key itself could be stored, encrypted by master key, as a metadata with the object ?<br /><br />Thanks<br /><br />Paul<br /><br /> </span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><blockquote style="border-width: medium medium medium 1pt; border-style: none none none solid; border-color: -moz-use-text-color -moz-use-text-color -moz-use-text-color rgb(204, 204, 204); padding: 0in 0in 0in 4pt; margin-left: 3.75pt; margin-right: 0in;"><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";">----- Original Message -----</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";">From: Bhandaru, Malini K</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";">Sent: 03/09/13 01:41 AM</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";">To: Nate Reller, OpenStack Development Mailing List</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";">Subject: Re: [openstack-dev] key manager proposal</span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoNormal"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><div><div><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);">Thank you Nate for detailed comments. Please do send your UML diagrams.</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";">-----Original Message-----<br />From: Nate Reller [<a href="mailto:rellerreller@yahoo.com">mailto:rellerreller@yahoo.com</a>]<br />Sent: Friday, March 08, 2013 12:16 PM<br />To: <a href="mailto:openstack-dev@lists.openstack.org">openstack-dev@lists.openstack.org</a><br />Subject: Re: [openstack-dev] key manager proposal</span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";">Malini,</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";">Sorry for the long reply, but I have a lot of thoughts on this. I like the proposal overall, but I have some concerns and suggestions.</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";">*** Master Key and Access for Compute Hosts ***</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";">My biggest concerns are with regards to the master key and preventing access to the compute hosts. In our proposal, encrypt-cinder-volumes, the compute host is encrypting the cinder volume data after it leaves the VM and before it is sent to the cinder host. Clearly we would like for compute hosts to have access to the Key Manager to allow them to encrypt the data.</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);">Yes, understand that you want compute host to do the encryption.</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);">Just as easy to establish trust-worthiness of compute hosts as normal service hosts.</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);">Currently VMs can be deployed on “trusted” and “untrusted” compute hosts.</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);">Likewise volumes can be attached  to trusted and untrusted compute hosts, and the volumes themselves </span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);">Encrypted or plain text.  </span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);">==================</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);">Host              |  Volume</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);">Untrusted    |   plain</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);">Untrusted    |   encrypted     </span><span style="font-size: 9pt; font-family: Wingdings; color: rgb(0, 112, 192);">è</span><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);">   “Mixed Bag”</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);">Trusted        |    plain</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);">Trusted        |   encrypted</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);">The issue then becomes “untrusted” compute host dealing with an encrypted volume.</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);">The “volume” master key only encrypts the key-string, just so key-strings are not in lying around as plain text on the key-manager node.</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);">Having the master key without the actual key is not useful.</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);">A volume is attached to a VM only after establishing that they all belong to the same user/project/domain. This is standard keystone token access</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);">Control after establishing authorization credentials.</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);">The encrypted key string is only released to Cinder/Compute host, after trust is delegated from the above authorization. </span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);">We could deliver the key to decrypt the volume to such a compute host encrypted with the host-PKI public-key because we do not want to</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);">Trust it with a master key because it has no TPM secure storage.</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);">May be I am missing something, and thus do not understand your concern.</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);">Volume = V</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);">Key to volume V = k-v</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);">Master = m</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);">If compute host has a/the master key == m, it still needs k-v and V (the encrypted volume) to get to the secrets.</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);">We are controlling access to k-v.</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);">The key manager holding the set of keys {k-v} will not have access to the master, and in so doing protects all the keys it  has.</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);">do not want to just save as plain text a symmetric key  (one of your interface related suggestions if I understand correctly)</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);">The common master, versus special handling is so that</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);">Volume = NateV</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);">Compute-node-host-A    Compute-node-host-B Compute-node-host-C</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);">Your VM should be technically able to run on the above A, B, or C and attach volume NateV.</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);">If master encryption key lives only on compute-node-host-A, then you can decrypt the volume only on A.</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);">Alternately if VM runs on compute-node-host-B, need to retrieve the master from compute-node-host-A or elsewhere.</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);">After retrieving master, then retrieve the volume specific key NateV-k.</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";">My other concern is with the master key idea. The compute hosts will be responsible for encrypting and decrypting the data for cinder volumes. If the keys for doing this are encrypted by a master key then the master key must be shared by all compute hosts that will use the cinder volume. That would require copying the master key to multiple platforms and that makes me nervous. This is my biggest concern with master keys encrypting other keys. It forces the master key to be shared with all entities that will use the key.</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";">I propose changing the interface to operate on generic Key objects. Then we can have classes of Key objects for different types of keys. One Key class may be a SymmetricKey class for storing AES keys and the like. Another Key class may be an EncryptedSymmetricKey class that stores a symmetric key that is encrypted by a master key. This way the interface can support the use cases for master keys and plain old symmetric keys. It would also support split keys. I can send a UML diagram or two with my thoughts if you like. Let me know.</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";">*** Authroization Token ***</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: rgb(0, 112, 192);">Certainly want to pass in other information, including encryption preferences (algorithm, key-size etc)</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif"; color: black;"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";">I like that your API takes in an authorization token. Do you have more details on what that would be? Our prototype right now takes in the context of the caller (i.e. the user). I would like to extend that to have the interface take in a security context that not only provides an authorization token from the user, but it may include other information as well. I am thinking about information specific to the platform. For instance, I may want to have the compute host provide a signed TPM quote, so the Key Manager can verify that the caller is from a particular platform. I would be interested in brainstorming more ideas on this.  I'm also not sure what the Keystone group is working on in this area. I also think it would be cool to integrate TNC into this, but I'm not sure how to do that.</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";">*** Miscellaneous Thoughts ***</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";">I would like to see the Key Manager as its own service. I think many different services have a need for a Key Manager and making it its own service would be useful.</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";">TPM could be used to encrypt all keys on Key Manager platform. Then you could lock the keys down unless the platform is in a specific state.</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";">I don't think we should limit key scope. I imagine there will be many different use cases for keys, and the key scope will be different for each one. It may also be different per deployment.</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";">This topic is of interest to the OpenStack Security Group (OSSG). You may want to join the meetings on Thursdays.</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";">Link to encrypt-cinder-volumes blueprint:</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"><a href="https://blueprints.launchpad.net/nova/+spec/encrypt-cinder-volumes"><span style="color: windowtext; text-decoration: none;">https://blueprints.launchpad.net/nova/+spec/encrypt-cinder-volumes</span></a></span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";">-Nate</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";">> When you get a chance we checkout</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";">> <a href="https://wiki.openstack.org/wiki/KeyManager"><span style="color: windowtext; text-decoration: none;">https://wiki.openstack.org/wiki/KeyManager</span></a> > I hope I have captured ideas and addressed concerns we have discussed on this mailing list.</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";">_______________________________________________</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";">OpenStack-dev mailing list</span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"><a href="mailto:OpenStack-dev@lists.openstack.org"><span style="color: windowtext; text-decoration: none;">OpenStack-dev@lists.openstack.org</span></a></span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p><p class="MsoPlainText"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"><a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev"><span style="color: windowtext; text-decoration: none;">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</span></a></span></p><p style="margin:0px; padding:0px;" > </p><p style="margin:0px; padding:0px; margin: 0in 0in 0.0001pt;"><span style="font-size: 9pt; font-family: "Verdana","sans-serif";"> </span></p><p style="margin:0px; padding:0px;" > </p></div></div></blockquote></div></div></blockquote></span></span>