<html><head><meta http-equiv="Content-Type" content="text/html; charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">Hi Sean,<div class=""><br class=""></div><div class="">You’re right, the issue isn’t the scheduler after all. I wasn’t fully aware of how the scheduler and conductor work with each other. From the logs, I can see that it does pick a compute node as selected host:</div><div class=""><br class=""></div><div class="">2020-06-05 17:50:54.742 520 DEBUG nova.conductor.manager [req-323fe2d5-4ab5-4d3f-a923-deb7ce9da9f9 0ec0114b913646338f16f1ce6457da3a e9dd8de2dad64f3c99078f26330aefb9 - default default] [instance: e1d20902-660e-4359-bb56-2482734b656f] Selected host: <a href="http://compute2.staging.planethoster.net" class="">compute2.staging.planethoster.net</a>; Selected node: <a href="http://compute2.staging.planethoster.net" class="">compute2.staging.planethoster.net</a>; Alternates: [(u'<a href="http://compute3.staging.planethoster.net" class="">compute3.staging.planethoster.net</a>', u'<a href="http://compute3.staging.planethoster.net" class="">compute3.staging.planethoster.net</a>'), (u'<a href="http://compute1.staging.planethoster.net" class="">compute1.staging.planethoster.net</a>', u'<a href="http://compute1.staging.planethoster.net" class="">compute1.staging.planethoster.net</a>')] schedule_and_build_instances /usr/lib/python2.7/site-packages/nova/conductor/manager.py:1371<br class=""><div class=""><br class="webkit-block-placeholder"></div><div class="">It then proceed to block device mapping :</div><div class=""><br class=""></div><div class="">2020-06-05 17:50:54.750 520 DEBUG nova.conductor.manager [req-323fe2d5-4ab5-4d3f-a923-deb7ce9da9f9 0ec0114b913646338f16f1ce6457da3a e9dd8de2dad64f3c99078f26330aefb9 - default default] [instance: e1d20902-660e-4359-bb56-2482734b656f] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=False,deleted=<?>,deleted_at=<?>,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=<?>,image_id='364b1fe6-6025-4ca5-8d7d-76fbd71074cb',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=20)] _create_block_device_mapping /usr/lib/python2.7/site-packages/nova/conductor/manager.py:1169</div><div class=""><br class=""></div><div class="">However, the status of the VM in the database stays at scheduling and the conductor doesn’t do anything else, as if it was waiting for something that never comes. So, would that mean that the scheduler and placement actually do their job, but the process gets stuck in cinder?</div><div class=""><br class=""></div><div class="">I was under the impression this was a nova issue, because if I shutdown my containers with the nova services and boot the same nova services with same configuration locally, I have no issue whatsoever.</div><div class=""><br class=""></div><div class="">
<div style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class=""><div style="color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;">Jean-Philippe Méthot</div><div style="color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;">Senior Openstack system administrator</div><div style="color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;">Administrateur système Openstack sénior</div><div style="color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;">PlanetHoster inc.</div><div style="color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;">4414-4416 Louis B Mayer<br class="">Laval, QC, H7P 0G1, Canada<br class="">TEL : +1.514.802.1644 - Poste : 2644<br class="">FAX : +1.514.612.0678<br class="">CA/US : 1.855.774.4678<br class="">FR : 01 76 60 41 43<br class="">UK : 0808 189 0423</div><div style="color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;"><br class=""></div><div style="color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;"><br class=""></div><div style="color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><br class=""></div><br class="Apple-interchange-newline"></div><br class="Apple-interchange-newline">
</div>
<div><br class=""><blockquote type="cite" class=""><div class="">Le 5 juin 2020 à 13:26, Sean Mooney <<a href="mailto:smooney@redhat.com" class="">smooney@redhat.com</a>> a écrit :</div><br class="Apple-interchange-newline"><div class=""><div class="">On Fri, 2020-06-05 at 12:33 -0400, Jean-Philippe Méthot wrote:<br class=""><blockquote type="cite" class="">Hi,<br class=""><br class="">I’ve been building my own docker images as a mean to both learn docker and to see if we can make our own images and<br class="">run them in production. I’ve figured out how to make most services run fairly well. However, an issue remains with<br class="">nova-scheduler and I can’t seem to figure out what’s going on.<br class=""><br class="">Essentially, when I try to create a VM it loops in a scheduling state and when I try to delete a VM, it loops forever<br class="">in a deleting state.<br class=""></blockquote><br class="">the scheduler is not invlvoed in deleteing a vm so this more or less rules out the schduler as teh route cause.<br class="">i woudl guess the issue likes somewhere beteen the api and conductor.<br class=""><br class=""><blockquote type="cite" class=""> I’ve narrowed down the culprit to nova-scheduler.<br class=""></blockquote>can you explaine why you think its the nova-schduler?<br class=""><blockquote type="cite" class=""> As far as I know, nothing appears in the debug logs of my containerized nova-scheduler whenever I do any kind of<br class="">action, which forces me to believe that nova-scheduler is not receiving any command.<br class=""></blockquote>did you confirm thjat the conductor was reciving the build requierst and calling the schduler.<br class=""><blockquote type="cite" class=""><br class="">From what I’ve always understood, nova-scheduler works through RPC and Rabbitmq. The fact that this nova-scheduler<br class="">connects to rabbitmq without issue makes me believe that something else is missing from my container configuration.<br class=""><br class="">Does Nova-scheduler listen on network port?<br class=""></blockquote>not the scudler only compunicates withthe conductor via the rpc bus.<br class=""><blockquote type="cite" class=""> Does it listen on a socket?<br class=""></blockquote>no<br class=""><blockquote type="cite" class=""> Is there any way that nova-scheduler could ignore requests sent to it?<br class=""></blockquote>only if it was not listening to the corerct exchange.<br class=""><br class="">i would first change that the api show an rpc to the conductor and validate that the conductor started the buidl<br class="">request.<br class="">if you see output in the conductor log realted to your api queries then you can check the logs to see if ti called the<br class="">schduler.<br class=""><blockquote type="cite" class=""><br class=""><br class="">Jean-Philippe Méthot<br class="">Senior Openstack system administrator<br class="">Administrateur système Openstack sénior<br class="">PlanetHoster inc.<br class=""><br class=""><br class=""><br class=""><br class=""><br class=""><br class=""></blockquote><br class=""></div></div></blockquote></div><br class=""></div></body></html>