<div dir="ltr">I got the metadata network accessible over a routed subnet! <div><br></div><div>The breakthrough was making sure I pointed 169.254.169.254 to the Neutron DHCP address rather than the physical or bridge IP address, this route added to the physical router (L3 switch) that serves the subnet hosting the Ironic controller.</div><div><br></div><div>Also, I made sure to add a host route for 169.254.169.254 to the baremetal remote subnet in Neutron so the baremetal nodes will have a proper route to the metadata subnet. </div><div><br></div><div>There is still some network tweaking left to do. We have a separate subnet for ESXi mgmt vmkernels since they use virtual MAC addresses and neutron doesn't recognize them. However, enabling DHCP relay for that separate subnet breaks routing which also breaks cleaning and deploying, and I need to find out where. </div><div><br></div><div>This is huge for our metal-as-a-service offering! </div><div><br></div><div>Thanks, </div><div>Tom King</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Sat, Aug 22, 2020 at 12:53 AM Thomas King <<a href="mailto:thomas.king@gmail.com">thomas.king@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="auto">Ok, thanks. </div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Fri, Aug 21, 2020, 11:39 PM Ruslanas Gžibovskis <<a href="mailto:ruslanas@lpic.lt" target="_blank">ruslanas@lpic.lt</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="auto">No, I didn't. In the beginning I wanted to say "yes" but that is for overcloud.<div dir="auto"><br></div><div dir="auto">Now I am thinking, maybe even I do no have metadata on undercloud....</div><div dir="auto"><br></div><div dir="auto">Will need to check on Monday.</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">2020-08-22, št 00:51, Thomas King <<a href="mailto:thomas.king@gmail.com" rel="noreferrer" target="_blank">thomas.king@gmail.com</a>> rašė:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">Finally got it worked out except for reaching the metadata service IP (169.254.169.254) from a remote network. Did you put specific routes in place for that IP address on your physical network? <div><br></div><div>Tom</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Jul 22, 2020 at 3:19 AM Ruslanas Gžibovskis <<a href="mailto:ruslanas@lpic.lt" rel="noreferrer noreferrer" target="_blank">ruslanas@lpic.lt</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div dir="ltr">Ok</div><br><div class="gmail_quote"><div class="gmail_attr">here is a small copy paste:</div><div class="gmail_attr"><a href="http://paste.openstack.org/show/o4Uay0DYbAdkcfUJGOLV/" rel="noreferrer noreferrer" target="_blank">http://paste.openstack.org/show/o4Uay0DYbAdkcfUJGOLV/</a> </div><div class="gmail_attr"><br></div><div class="gmail_attr">also have relaunched previous commands, as I have redeployed overcloud :)</div><div class="gmail_attr"><br></div><div class="gmail_attr">and maybe you will be interested, in undercloud containers running:</div><div class="gmail_attr"><br></div><div class="gmail_attr"> (undercloud) [stack@remote-u overcloud]$ sudo podman ps<br></div>CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES<br>39c684172ce7 <a href="http://docker.io/tripleomaster/centos-binary-neutron-dhcp-agent:current-tripleo" rel="noreferrer noreferrer" target="_blank">docker.io/tripleomaster/centos-binary-neutron-dhcp-agent:current-tripleo</a> /usr/sbin/dnsmasq... 7 days ago Up 7 days ago neutron-dnsmasq-qdhcp-e6d6c50b-fb69-4375-bb7d-0f6e0cfed5cb<br>30ccb169e666 <a href="http://docker.io/tripleomaster/centos-binary-ironic-pxe:current-tripleo" rel="noreferrer noreferrer" target="_blank">docker.io/tripleomaster/centos-binary-ironic-pxe:current-tripleo</a> kolla_start 7 days ago Up 7 days ago ironic_pxe_http<br>6a62e08e8e10 <a href="http://docker.io/tripleomaster/centos-binary-ironic-pxe:current-tripleo" rel="noreferrer noreferrer" target="_blank">docker.io/tripleomaster/centos-binary-ironic-pxe:current-tripleo</a> /bin/bash -c BIND... 7 days ago Up 7 days ago ironic_pxe_tftp<br>e4cbad7f7488 <a href="http://docker.io/tripleomaster/centos-binary-neutron-l3-agent:current-tripleo" rel="noreferrer noreferrer" target="_blank">docker.io/tripleomaster/centos-binary-neutron-l3-agent:current-tripleo</a> kolla_start 7 days ago Up 7 days ago neutron_l3_agent<br>d78d3828c420 <a href="http://docker.io/tripleomaster/centos-binary-neutron-openvswitch-agent:current-tripleo" rel="noreferrer noreferrer" target="_blank">docker.io/tripleomaster/centos-binary-neutron-openvswitch-agent:current-tripleo</a> kolla_start 7 days ago Up 7 days ago neutron_ovs_agent<br>3b67b6a69a87 <a href="http://docker.io/tripleomaster/centos-binary-neutron-dhcp-agent:current-tripleo" rel="noreferrer noreferrer" target="_blank">docker.io/tripleomaster/centos-binary-neutron-dhcp-agent:current-tripleo</a> kolla_start 7 days ago Up 7 days ago neutron_dhcp<br>46d403293b54 <a href="http://docker.io/tripleomaster/centos-binary-swift-proxy-server:current-tripleo" rel="noreferrer noreferrer" target="_blank">docker.io/tripleomaster/centos-binary-swift-proxy-server:current-tripleo</a> kolla_start 7 days ago Up 7 days ago swift_proxy<br>15a9792d6f62 <a href="http://docker.io/tripleomaster/centos-binary-swift-object:current-tripleo" rel="noreferrer noreferrer" target="_blank">docker.io/tripleomaster/centos-binary-swift-object:current-tripleo</a> kolla_start 7 days ago Up 7 days ago swift_rsync<br>0e6cd094d6dc <a href="http://docker.io/tripleomaster/centos-binary-swift-object:current-tripleo" rel="noreferrer noreferrer" target="_blank">docker.io/tripleomaster/centos-binary-swift-object:current-tripleo</a> kolla_start 7 days ago Up 7 days ago swift_object_updater<br>80b7f26e742d <a href="http://docker.io/tripleomaster/centos-binary-swift-object:current-tripleo" rel="noreferrer noreferrer" target="_blank">docker.io/tripleomaster/centos-binary-swift-object:current-tripleo</a> kolla_start 7 days ago Up 7 days ago swift_object_server<br>765f79633499 <a href="http://docker.io/tripleomaster/centos-binary-swift-proxy-server:current-tripleo" rel="noreferrer noreferrer" target="_blank">docker.io/tripleomaster/centos-binary-swift-proxy-server:current-tripleo</a> kolla_start 7 days ago Up 7 days ago swift_object_expirer<br>0e53da61af88 <a href="http://docker.io/tripleomaster/centos-binary-swift-container:current-tripleo" rel="noreferrer noreferrer" target="_blank">docker.io/tripleomaster/centos-binary-swift-container:current-tripleo</a> kolla_start 7 days ago Up 7 days ago swift_container_updater<br>8c14cef58eb3 <a href="http://docker.io/tripleomaster/centos-binary-swift-account:current-tripleo" rel="noreferrer noreferrer" target="_blank">docker.io/tripleomaster/centos-binary-swift-account:current-tripleo</a> kolla_start 7 days ago Up 7 days ago swift_account_server<br>12930a63dc12 <a href="http://docker.io/tripleomaster/centos-binary-swift-container:current-tripleo" rel="noreferrer noreferrer" target="_blank">docker.io/tripleomaster/centos-binary-swift-container:current-tripleo</a> kolla_start 7 days ago Up 7 days ago swift_container_server<br>8a5cd45208c0 <a href="http://docker.io/tripleomaster/centos-binary-swift-account:current-tripleo" rel="noreferrer noreferrer" target="_blank">docker.io/tripleomaster/centos-binary-swift-account:current-tripleo</a> kolla_start 7 days ago Up 7 days ago swift_account_reaper<br>b871400bfdd9 <a href="http://docker.io/tripleomaster/centos-binary-mistral-executor:current-tripleo" rel="noreferrer noreferrer" target="_blank">docker.io/tripleomaster/centos-binary-mistral-executor:current-tripleo</a> kolla_start 7 days ago Up 7 days ago mistral_executor<br>3e98e5f83f09 <a href="http://docker.io/tripleomaster/centos-binary-mistral-event-engine:current-tripleo" rel="noreferrer noreferrer" target="_blank">docker.io/tripleomaster/centos-binary-mistral-event-engine:current-tripleo</a> kolla_start 7 days ago Up 7 days ago mistral_event_engine<br>52d711dffca3 <a href="http://docker.io/tripleomaster/centos-binary-mistral-engine:current-tripleo" rel="noreferrer noreferrer" target="_blank">docker.io/tripleomaster/centos-binary-mistral-engine:current-tripleo</a> kolla_start 7 days ago Up 7 days ago mistral_engine<br>23dec12e650f <a href="http://docker.io/tripleomaster/centos-binary-iscsid:current-tripleo" rel="noreferrer noreferrer" target="_blank">docker.io/tripleomaster/centos-binary-iscsid:current-tripleo</a> kolla_start 7 days ago Up 7 days ago iscsid<br>bafff227d9d7 <a href="http://docker.io/tripleomaster/centos-binary-haproxy:current-tripleo" rel="noreferrer noreferrer" target="_blank">docker.io/tripleomaster/centos-binary-haproxy:current-tripleo</a> kolla_start 7 days ago Up 7 days ago haproxy<br>4d17cbd60698 <a href="http://docker.io/tripleomaster/centos-binary-ironic-inspector:current-tripleo" rel="noreferrer noreferrer" target="_blank">docker.io/tripleomaster/centos-binary-ironic-inspector:current-tripleo</a> kolla_start 7 days ago Up 7 days ago ironic_inspector_dnsmasq<br>f77e49246c35 <a href="http://docker.io/tripleomaster/centos-binary-ironic-inspector:current-tripleo" rel="noreferrer noreferrer" target="_blank">docker.io/tripleomaster/centos-binary-ironic-inspector:current-tripleo</a> kolla_start 7 days ago Up 7 days ago ironic_inspector<br>ec70f40bba04 <a href="http://docker.io/tripleomaster/centos-binary-rabbitmq:current-tripleo" rel="noreferrer noreferrer" target="_blank">docker.io/tripleomaster/centos-binary-rabbitmq:current-tripleo</a> kolla_start 5 weeks ago Up 4 weeks ago rabbitmq<br>f09c9a129d85 <a href="http://docker.io/tripleomaster/centos-binary-memcached:current-tripleo" rel="noreferrer noreferrer" target="_blank">docker.io/tripleomaster/centos-binary-memcached:current-tripleo</a> kolla_start 5 weeks ago Up 4 weeks ago memcached<br>0eb1e953dcaa <a href="http://docker.io/tripleomaster/centos-binary-nova-compute-ironic:current-tripleo" rel="noreferrer noreferrer" target="_blank">docker.io/tripleomaster/centos-binary-nova-compute-ironic:current-tripleo</a> kolla_start 7 weeks ago Up 4 weeks ago nova_compute<br>ac78778d2cb0 <a href="http://docker.io/tripleomaster/centos-binary-ironic-neutron-agent:current-tripleo" rel="noreferrer noreferrer" target="_blank">docker.io/tripleomaster/centos-binary-ironic-neutron-agent:current-tripleo</a> kolla_start 7 weeks ago Up 4 weeks ago ironic_neutron_agent<br>8660bf80fd9c <a href="http://docker.io/tripleomaster/centos-binary-ironic-conductor:current-tripleo" rel="noreferrer noreferrer" target="_blank">docker.io/tripleomaster/centos-binary-ironic-conductor:current-tripleo</a> kolla_start 7 weeks ago Up 4 weeks ago ironic_conductor<br>9dead5068168 <a href="http://docker.io/tripleomaster/centos-binary-mistral-api:current-tripleo" rel="noreferrer noreferrer" target="_blank">docker.io/tripleomaster/centos-binary-mistral-api:current-tripleo</a> kolla_start 7 weeks ago Up 4 weeks ago mistral_api<br>f5c1c9d6166c <a href="http://docker.io/tripleomaster/centos-binary-ironic-api:current-tripleo" rel="noreferrer noreferrer" target="_blank">docker.io/tripleomaster/centos-binary-ironic-api:current-tripleo</a> kolla_start 7 weeks ago Up 4 weeks ago ironic_api<br>48899d782dd5 <a href="http://docker.io/tripleomaster/centos-binary-nova-api:current-tripleo" rel="noreferrer noreferrer" target="_blank">docker.io/tripleomaster/centos-binary-nova-api:current-tripleo</a> kolla_start 7 weeks ago Up 4 weeks ago nova_api_cron<br>1b19c94834e8 <a href="http://docker.io/tripleomaster/centos-binary-nova-api:current-tripleo" rel="noreferrer noreferrer" target="_blank">docker.io/tripleomaster/centos-binary-nova-api:current-tripleo</a> kolla_start 7 weeks ago Up 4 weeks ago nova_api<br>5b66d128c930 <a href="http://docker.io/tripleomaster/centos-binary-glance-api:current-tripleo" rel="noreferrer noreferrer" target="_blank">docker.io/tripleomaster/centos-binary-glance-api:current-tripleo</a> kolla_start 7 weeks ago Up 4 weeks ago glance_api<br>7e63cdb8d6b4 <a href="http://docker.io/tripleomaster/centos-binary-placement-api:current-tripleo" rel="noreferrer noreferrer" target="_blank">docker.io/tripleomaster/centos-binary-placement-api:current-tripleo</a> kolla_start 7 weeks ago Up 4 weeks ago placement_api<br>2db105676f8b <a href="http://docker.io/tripleomaster/centos-binary-zaqar-wsgi:current-tripleo" rel="noreferrer noreferrer" target="_blank">docker.io/tripleomaster/centos-binary-zaqar-wsgi:current-tripleo</a> kolla_start 7 weeks ago Up 4 weeks ago zaqar_websocket<br>d3e5ae7368e6 <a href="http://docker.io/tripleomaster/centos-binary-zaqar-wsgi:current-tripleo" rel="noreferrer noreferrer" target="_blank">docker.io/tripleomaster/centos-binary-zaqar-wsgi:current-tripleo</a> kolla_start 7 weeks ago Up 4 weeks ago zaqar<br>6332e26b40ec <a href="http://docker.io/tripleomaster/centos-binary-nova-scheduler:current-tripleo" rel="noreferrer noreferrer" target="_blank">docker.io/tripleomaster/centos-binary-nova-scheduler:current-tripleo</a> kolla_start 7 weeks ago Up 4 weeks ago nova_scheduler<br>a5b0e0904f0c <a href="http://docker.io/tripleomaster/centos-binary-nova-conductor:current-tripleo" rel="noreferrer noreferrer" target="_blank">docker.io/tripleomaster/centos-binary-nova-conductor:current-tripleo</a> kolla_start 7 weeks ago Up 4 weeks ago nova_conductor<br>4460302d97c8 <a href="http://docker.io/tripleomaster/centos-binary-neutron-server:current-tripleo" rel="noreferrer noreferrer" target="_blank">docker.io/tripleomaster/centos-binary-neutron-server:current-tripleo</a> kolla_start 7 weeks ago Up 4 weeks ago neutron_api<br>d418deb9ea13 <a href="http://docker.io/tripleomaster/centos-binary-cron:current-tripleo" rel="noreferrer noreferrer" target="_blank">docker.io/tripleomaster/centos-binary-cron:current-tripleo</a> kolla_start 7 weeks ago Up 4 weeks ago logrotate_crond<br>7225ff80b26d <a href="http://docker.io/tripleomaster/centos-binary-heat-engine:current-tripleo" rel="noreferrer noreferrer" target="_blank">docker.io/tripleomaster/centos-binary-heat-engine:current-tripleo</a> kolla_start 7 weeks ago Up 4 weeks ago heat_engine<br>84d22b3b1663 <a href="http://docker.io/tripleomaster/centos-binary-heat-api:current-tripleo" rel="noreferrer noreferrer" target="_blank">docker.io/tripleomaster/centos-binary-heat-api:current-tripleo</a> kolla_start 7 weeks ago Up 4 weeks ago heat_api_cron<br>226e0d839772 <a href="http://docker.io/tripleomaster/centos-binary-heat-api:current-tripleo" rel="noreferrer noreferrer" target="_blank">docker.io/tripleomaster/centos-binary-heat-api:current-tripleo</a> kolla_start 7 weeks ago Up 4 weeks ago heat_api<br>6f7871a64325 <a href="http://docker.io/tripleomaster/centos-binary-keystone:current-tripleo" rel="noreferrer noreferrer" target="_blank">docker.io/tripleomaster/centos-binary-keystone:current-tripleo</a> kolla_start 7 weeks ago Up 4 weeks ago keystone<br>8402ff823012 <a href="http://docker.io/tripleomaster/centos-binary-mariadb:current-tripleo" rel="noreferrer noreferrer" target="_blank">docker.io/tripleomaster/centos-binary-mariadb:current-tripleo</a> kolla_start 7 weeks ago Up 4 weeks ago mysql<br>(undercloud) [stack@remote-u overcloud]$</div></div>
</blockquote></div>
</blockquote></div>
</blockquote></div>
</blockquote></div>