
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN">

<html><body style='font-family: Verdana,Geneva,sans-serif'>

<p>Nora,</p>

<p>This is a development list.  Your questions sound more related to usage, so you might have better luck asking on the users list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</p>

<p>Thanks.</p>

<p>-Ben</p>

<p> </p>

<p>On 2014-03-03 03:09, Nora Zhou wrote:</p>

<blockquote type="cite" style="padding-left:5px; border-left:#1010ff 2px solid; margin-left:5px"><!-- html ignored --><!-- head ignored --><!-- meta ignored --><!-- meta ignored --><!-- node type 8 --><!-- node type 8 -->

<div class="WordSection1">

<p class="MsoNormal"><span style="mso-fareast-language: ZH-HK;">Hi,<!-- o ignored --></span></p>

<p class="MsoNormal"><span style="mso-fareast-language: ZH-HK;"><!-- o ignored --> </span></p>

<p style="mso-margin-top-alt: 0cm; margin-right: 0cm; margin-bottom: 10.5pt; margin-left: 0cm; background: white;"><span style="font-size: 10.5pt; font-family: 'Arial','sans-serif'; color: #4b4b4b;">I recently deploy Bare-metal node instance using Heat Template. However, </span><span style="font-size: 10.5pt; font-family: 'Arial','sans-serif'; color: #4b4b4b; mso-fareast-language: ZH-HK;">Nova failed to spawn due to</span><span style="font-size: 10.5pt; font-family: 'Arial','sans-serif'; color: #4b4b4b;"> a timeout error. When I look into the code I found that the timeout is related to Nova downloading disk image from Glance. The nova-schedule.log shows below:<!-- o ignored --></span></p>

<p style="mso-margin-top-alt: 0cm; margin-right: 0cm; margin-bottom: 10.5pt; margin-left: 0cm; background: white; orphans: auto; text-align: start; widows: auto; -webkit-text-stroke-width: 0px; word-spacing: 0px;"><span style="font-size: 10.5pt; font-family: 'Arial','sans-serif'; color: #4b4b4b;">2014-02-28 02:49:48.046 2136 ERROR nova.compute.manager [req-09e61b23-436f-4425-8db0-10dd1aea2e39 85bbc1abb4254761a5452654a6934b75 692e595702654930936a65d1a658cff4] [instance: 35d00082-4cb4-45a3-a73b-b72ef2a6e2b2] Instance failed to spawn<!-- o ignored --></span></p>

<p style="mso-margin-top-alt: 0cm; margin-right: 0cm; margin-bottom: 10.5pt; margin-left: 0cm; background: white; orphans: auto; text-align: start; widows: auto; -webkit-text-stroke-width: 0px; word-spacing: 0px;"><span style="font-size: 10.5pt; font-family: 'Arial','sans-serif'; color: #4b4b4b;">2014-02-28 02:49:48.046 2136 TRACE nova.compute.manager [instance: 35d00082-4cb4-45a3-a73b-b72ef2a6e2b2] Traceback (most recent call last):<!-- o ignored --></span></p>

<p style="mso-margin-top-alt: 0cm; margin-right: 0cm; margin-bottom: 10.5pt; margin-left: 0cm; background: white; orphans: auto; text-align: start; widows: auto; -webkit-text-stroke-width: 0px; word-spacing: 0px;"><span style="font-size: 10.5pt; font-family: 'Arial','sans-serif'; color: #4b4b4b;">2014-02-28 02:49:48.046 2136 TRACE nova.compute.manager [instance: 35d00082-4cb4-45a3-a73b-b72ef2a6e2b2] File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1417, in _spawn/ 2014-02-28 02:49:48.046 2136 TRACE nova.compute.manager [instance: 35d00082-4cb4-45a3-a73b-b72ef2a6e2b2] network_info=network_info,<!-- o ignored --></span></p>

<p style="mso-margin-top-alt: 0cm; margin-right: 0cm; margin-bottom: 10.5pt; margin-left: 0cm; background: white; orphans: auto; text-align: start; widows: auto; -webkit-text-stroke-width: 0px; word-spacing: 0px;"><span style="font-size: 10.5pt; font-family: 'Arial','sans-serif'; color: #4b4b4b;">2014-02-28 02:49:48.046 2136 TRACE nova.compute.manager [instance: 35d00082-4cb4-45a3-a73b-b72ef2a6e2b2] File "/usr/lib/python2.7/dist-packages/nova/virt/baremetal/pxe.py", line 444, in cache_images 2014-02-28 02:49:48.046 2136 TRACE nova.compute.manager [instance: 35d00082-4cb4-45a3-a73b-b72ef2a6e2b2] self._cache_tftp_images(context, instance, tftp_image_info)<!-- o ignored --></span></p>

<p style="mso-margin-top-alt: 0cm; margin-right: 0cm; margin-bottom: 10.5pt; margin-left: 0cm; background: white; orphans: auto; text-align: start; widows: auto; -webkit-text-stroke-width: 0px; word-spacing: 0px;"><span style="font-size: 10.5pt; font-family: 'Arial','sans-serif'; color: #4b4b4b;">2014-02-28 02:49:48.046 2136 TRACE nova.compute.manager [instance: 35d00082-4cb4-45a3-a73b-b72ef2a6e2b2] File "/usr/lib/python2.7/dist-packages/nova/virt/baremetal/pxe.py", line 335, in _cache_tftp_images 2014-02-28 02:49:48.046 2136 TRACE nova.compute.manager [instance: 35d00082-4cb4-45a3-a73b-b72ef2a6e2b2] project_id=instance['project_id'],<!-- o ignored --></span></p>

<p style="mso-margin-top-alt: 0cm; margin-right: 0cm; margin-bottom: 10.5pt; margin-left: 0cm; background: white; orphans: auto; text-align: start; widows: auto; -webkit-text-stroke-width: 0px; word-spacing: 0px;"><span style="font-size: 10.5pt; font-family: 'Arial','sans-serif'; color: #4b4b4b;">2014-02-28 02:49:48.046 2136 TRACE nova.compute.manager [instance: 35d00082-4cb4-45a3-a73b-b72ef2a6e2b2] File "/usr/lib/python2.7/dist-packages/nova/virt/baremetal/utils.py", line 33, in cache_image 2014-02-28 02:49:48.046 2136 TRACE nova.compute.manager [instance: 35d00082-4cb4-45a3-a73b-b72ef2a6e2b2] user_id, project_id)<!-- o ignored --></span></p>

<p style="mso-margin-top-alt: 0cm; margin-right: 0cm; margin-bottom: 10.5pt; margin-left: 0cm; background: white; orphans: auto; text-align: start; widows: auto; -webkit-text-stroke-width: 0px; word-spacing: 0px;"><span style="font-size: 10.5pt; font-family: 'Arial','sans-serif'; color: #4b4b4b;">2014-02-28 02:49:48.046 2136 TRACE nova.compute.manager [instance: 35d00082-4cb4-45a3-a73b-b72ef2a6e2b2] File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/utils.py", line 645, in fetch_image 2014-02-28 02:49:48.046 2136 TRACE nova.compute.manager [instance: 35d00082-4cb4-45a3-a73b-b72ef2a6e2b2] max_size=max_size)<!-- o ignored --></span></p>

<p style="mso-margin-top-alt: 0cm; margin-right: 0cm; margin-bottom: 10.5pt; margin-left: 0cm; background: white; orphans: auto; text-align: start; widows: auto; -webkit-text-stroke-width: 0px; word-spacing: 0px;"><span style="font-size: 10.5pt; font-family: 'Arial','sans-serif'; color: #4b4b4b;">2014-02-28 02:49:48.046 2136 TRACE nova.compute.manager [instance: 35d00082-4cb4-45a3-a73b-b72ef2a6e2b2] File "/usr/lib/python2.7/dist-packages/nova/virt/images.py", line 196, in fetch_to_raw 2014-02-28 02:49:48.046 2136 TRACE nova.compute.manager [instance: 35d00082-4cb4-45a3-a73b-b72ef2a6e2b2] max_size=max_size)<!-- o ignored --></span></p>

<p style="mso-margin-top-alt: 0cm; margin-right: 0cm; margin-bottom: 10.5pt; margin-left: 0cm; background: white; orphans: auto; text-align: start; widows: auto; -webkit-text-stroke-width: 0px; word-spacing: 0px;"><span style="font-size: 10.5pt; font-family: 'Arial','sans-serif'; color: #4b4b4b;">2014-02-28 02:49:48.046 2136 TRACE nova.compute.manager [instance: 35d00082-4cb4-45a3-a73b-b72ef2a6e2b2] File "/usr/lib/python2.7/dist-packages/nova/virt/images.py", line 190, in fetch 2014-02-28 02:49:48.046 2136 TRACE nova.compute.manager [instance: 35d00082-4cb4-45a3-a73b-b72ef2a6e2b2] image_service.download(context, image_id, dst_path=path)<!-- o ignored --></span></p>

<p style="mso-margin-top-alt: 0cm; margin-right: 0cm; margin-bottom: 10.5pt; margin-left: 0cm; background: white; orphans: auto; text-align: start; widows: auto; -webkit-text-stroke-width: 0px; word-spacing: 0px;"><span style="font-size: 10.5pt; font-family: 'Arial','sans-serif'; color: #4b4b4b;">2014-02-28 02:49:48.046 2136 TRACE nova.compute.manager [instance: 35d00082-4cb4-45a3-a73b-b72ef2a6e2b2] File "/usr/lib/python2.7/dist-packages/nova/image/glance.py", line 360, in download 2014-02-28 02:49:48.046 2136 TRACE nova.compute.manager [instance: 35d00082-4cb4-45a3-a73b-b72ef2a6e2b2] for chunk in image_chunks:<!-- o ignored --></span></p>

<p style="mso-margin-top-alt: 0cm; margin-right: 0cm; margin-bottom: 10.5pt; margin-left: 0cm; background: white; orphans: auto; text-align: start; widows: auto; -webkit-text-stroke-width: 0px; word-spacing: 0px;"><span style="font-size: 10.5pt; font-family: 'Arial','sans-serif'; color: #4b4b4b;">2014-02-28 02:49:48.046 2136 TRACE nova.compute.manager [instance: 35d00082-4cb4-45a3-a73b-b72ef2a6e2b2] File "/usr/lib/python2.7/dist-packages/glanceclient/common/http.py", line 478, in __iter__ 2014-02-28 02:49:48.046 2136 TRACE nova.compute.manager [instance: 35d00082-4cb4-45a3-a73b-b72ef2a6e2b2] chunk = self.next()<!-- o ignored --></span></p>

<p style="mso-margin-top-alt: 0cm; margin-right: 0cm; margin-bottom: 10.5pt; margin-left: 0cm; background: white; orphans: auto; text-align: start; widows: auto; -webkit-text-stroke-width: 0px; word-spacing: 0px;"><span style="font-size: 10.5pt; font-family: 'Arial','sans-serif'; color: #4b4b4b;">2014-02-28 02:49:48.046 2136 TRACE nova.compute.manager [instance: 35d00082-4cb4-45a3-a73b-b72ef2a6e2b2] File "/usr/lib/python2.7/dist-packages/glanceclient/common/http.py", line 494, in next 2014-02-28 02:49:48.046 2136 TRACE nova.compute.manager [instance: 35d00082-4cb4-45a3-a73b-b72ef2a6e2b2] chunk = self._resp.read(CHUNKSIZE)<!-- o ignored --></span></p>

<p style="mso-margin-top-alt: 0cm; margin-right: 0cm; margin-bottom: 10.5pt; margin-left: 0cm; background: white;"><span style="font-size: 10.5pt; font-family: 'Arial','sans-serif'; color: #4b4b4b;">2014-02-28 02:49:48.046 2136 TRACE nova.compute.manager [instance: 35d00082-4cb4-45a3-a73b-b72ef2a6e2b2] File "/usr/lib/python2.7/httplib.py", line 561, in read 2014-02-28 02:49:48.046 2136 TRACE nova.compute.manager [instance: 35d00082-4cb4-45a3-a73b-b72ef2a6e2b2] s = self.fp.read(amt)<!-- o ignored --></span></p>

<p style="mso-margin-top-alt: 0cm; margin-right: 0cm; margin-bottom: 10.5pt; margin-left: 0cm; background: white; orphans: auto; text-align: start; widows: auto; -webkit-text-stroke-width: 0px; word-spacing: 0px;"><span style="font-size: 10.5pt; font-family: 'Arial','sans-serif'; color: #4b4b4b;">2014-02-28 02:49:48.046 2136 TRACE nova.compute.manager [instance: 35d00082-4cb4-45a3-a73b-b72ef2a6e2b2] File "/usr/lib/python2.7/socket.py", line 380, in read 2014-02-28 02:49:48.046 2136 TRACE nova.compute.manager [instance: 35d00082-4cb4-45a3-a73b-b72ef2a6e2b2] data = self._sock.recv(left)<!-- o ignored --></span></p>

<p style="mso-margin-top-alt: 0cm; margin-right: 0cm; margin-bottom: 10.5pt; margin-left: 0cm; background: white; orphans: auto; text-align: start; widows: auto; -webkit-text-stroke-width: 0px; word-spacing: 0px;"><span style="font-size: 10.5pt; font-family: 'Arial','sans-serif'; color: #4b4b4b;">2014-02-28 02:49:48.046 2136 TRACE nova.compute.manager [instance: 35d00082-4cb4-45a3-a73b-b72ef2a6e2b2] File "/usr/lib/python2.7/dist-packages/eventlet/greenio.py", line 262, in recv 2014-02-28 02:49:48.046 2136 TRACE nova.compute.manager [instance: 35d00082-4cb4-45a3-a73b-b72ef2a6e2b2] timeout_exc=socket.timeout("timed out"))<!-- o ignored --></span></p>

<p style="mso-margin-top-alt: 0cm; margin-right: 0cm; margin-bottom: 10.5pt; margin-left: 0cm; background: white; orphans: auto; text-align: start; widows: auto; -webkit-text-stroke-width: 0px; word-spacing: 0px;"><span style="font-size: 10.5pt; font-family: 'Arial','sans-serif'; color: #4b4b4b;">2014-02-28 02:49:48.046 2136 TRACE nova.compute.manager [instance: 35d00082-4cb4-45a3-a73b-b72ef2a6e2b2] File "/usr/lib/python2.7/dist-packages/eventlet/hubs/__init__.py", line 155, in trampoline 2014-02-28 02:49:48.046 2136 TRACE nova.compute.manager [instance: 35d00082-4cb4-45a3-a73b-b72ef2a6e2b2] return hub.switch()<!-- o ignored --></span></p>

<p style="mso-margin-top-alt: 0cm; margin-right: 0cm; margin-bottom: 10.5pt; margin-left: 0cm; background: white; orphans: auto; text-align: start; widows: auto; -webkit-text-stroke-width: 0px; word-spacing: 0px;"><span style="font-size: 10.5pt; font-family: 'Arial','sans-serif'; color: #4b4b4b;">2014-02-28 02:49:48.046 2136 TRACE nova.compute.manager [instance: 35d00082-4cb4-45a3-a73b-b72ef2a6e2b2] File "/usr/lib/python2.7/dist-packages/eventlet/hubs/hub.py", line 187, in switch 2014-02-28 02:49:48.046 2136 TRACE nova.compute.manager [instance: 35d00082-4cb4-45a3-a73b-b72ef2a6e2b2] return self.greenlet.switch() 2014-02-28 02:49:48.046 2136 TRACE nova.compute.manager [instance: 35d00082-4cb4-45a3-a73b-b72ef2a6e2b2] timeout: timed out<!-- o ignored --></span></p>

<p style="mso-margin-top-alt: 0cm; margin-right: 0cm; margin-bottom: 10.5pt; margin-left: 0cm; background: white; orphans: auto; text-align: start; widows: auto; -webkit-text-stroke-width: 0px; word-spacing: 0px;"><span style="font-size: 10.5pt; font-family: 'Arial','sans-serif'; color: #4b4b4b;">I don't know where the timeout is set. And does Nova download image from Glance in parallel or in sequential way?<!-- o ignored --></span></p>

<p style="mso-margin-top-alt: 0cm; margin-right: 0cm; margin-bottom: 10.5pt; margin-left: 0cm; background: white; orphans: auto; text-align: start; widows: auto; -webkit-text-stroke-width: 0px; word-spacing: 0px;"><span style="font-size: 10.5pt; font-family: 'Arial','sans-serif'; color: #4b4b4b;">Thank you very much</span><span style="font-size: 10.5pt; font-family: 'Arial','sans-serif'; color: #4b4b4b; mso-fareast-language: ZH-HK;">.<!-- o ignored --></span></p>

<p class="MsoNormal"><span style="mso-fareast-language: ZH-HK;">Best regards,<!-- o ignored --></span></p>

<p class="MsoNormal"><span style="mso-fareast-language: ZH-HK;">Nora<!-- o ignored --></span></p>

</div>

<!-- html ignored --><br />

<pre>_______________________________________________

OpenStack-dev mailing list

<a href="mailto:OpenStack-dev@lists.openstack.org">OpenStack-dev@lists.openstack.org</a>

<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</a>

</pre>

</blockquote>

<p> </p>

<div> </div>

</body></html>