<!DOCTYPE html>
<html><head>
<meta charset="UTF-8">
<style type="text/css">.mceResizeHandle {position: absolute;border: 1px solid black;background: #FFF;width: 5px;height: 5px;z-index: 10000}.mceResizeHandle:hover {background: #000}img[data-mce-selected] {outline: 1px solid black}img.mceClonedResizable, table.mceClonedResizable {position: absolute;outline: 1px dashed black;opacity: .5;z-index: 10000}
</style></head><body style=""><div>Hi everyone,</div>
<div> </div>
<div>we have a little problem with our openstack installation using shared storage with ocfs2 over iSCSI with multipath, as OpenStack version we are running Mitaka and Ubuntu 16.04.3.</div>
<div> </div>
<div>We have totally 10 compute nodes. We have 2 shared storage volumes which one of the is used by compute node 1-5 and the other one is used by 6-10 as ephermal storage.</div>
<div> </div>
<div>Now, when we start a new instance from a new image which is not in the image cache, its working fine and the copy process from glance to the image cache is fast as ist should be over 10GBit/s. If we do the same but starting more instances at once like 2..xx and this instances start on more than one compute node in the group 1-5 or 6-10 than the instances are take very long (30 minute) to start or they even run into error states.</div>
<div> </div>
<div>We see that then the copy process of the image to the image cache is VERY slow, its like 1-2 MByte every second. It seems that more than one compute node is trying to copy the image in the cache and so start to block the shared filesystem. All compute nodes who try this are marked as down in horizon dashboard, but on the host the libvirt-bin or nova-compute service is running but nova-compute has stopped to write into the logfiles, seems also freezed somehow.</div>
<div> </div>
<div>After the copy process of the image in the cache has finished all nodes recover and going back up again.</div>
<div> </div>
<div>Did someone see this behaviour or is this known? Is this a bug or a configuration problem and can be solved somehow?</div>
<div> </div>
Thank you and kind regards,
<div>Michael<br><br>Michael Stang<br>Laboringenieur, Dipl. Inf. (FH)<br><br>Duale Hochschule Baden-Württemberg Mannheim<br>Baden-Wuerttemberg Cooperative State University Mannheim<br>ZeMath Zentrum für mathematisch-naturwissenschaftliches Basiswissen<br>Fachbereich Informatik, Fakultät Technik<br>Coblitzallee 1-9<br>68163 Mannheim<br><br>michael.stang@dhbw-mannheim.de<br>http://www.dhbw-mannheim.de<br><br><br><br><img src="http://www.dhbw-mannheim.de/fileadmin/media/mail/signatur/dhbw_logo_mail.jpg" border="0"><br><br></div></body></html>