<div dir="ltr"><div dir="ltr">Hi Herald,</div><div>please find the response in line:</div><div><br></div><div dir="ltr">* Verify that the TFTP server is running?</div><div><b>[Loke]</b></div><div dir="ltr"><b>TFTP Container is running but is in unhealthy state:</b></div><div dir="ltr"><b>[root@undercloud ironic]# podman ps -a | grep tftp<br>b3fb26bcf190  undercloud.ctlplane.localdomain:8787/tripleowallaby/openstack-ironic-pxe:current-tripleo                 /bin/bash -c BIND...  4 hours ago  Up 4 hours ago (unhealthy)              ironic_pxe_tftp<br>[root@undercloud ironic]#</b></div><div dir="ltr"><br>* Check the log file - /var/log/containers/ironic/dnsmasq.log</div><div><b>[Loke]: ERROR</b></div><div dir="ltr"><b>[root@undercloud ironic]# tail -f dnsmasq.log<br>Jun 18 04:41:10 dnsmasq[11]: started, version 2.79 DNS disabled<br>Jun 18 04:41:10 dnsmasq[11]: compile time options: IPv6 GNU-getopt DBus no-i18n IDN2 DHCP DHCPv6 no-Lua TFTP no-conntrack ipset auth DNSSEC loop-detect inotify<br>Jun 18 04:41:10 dnsmasq-tftp[11]: TFTP root is /var/lib/ironic/tftpboot<br>Jun 18 08:09:21 dnsmasq-tftp[11]: failed sending /var/lib/ironic/tftpboot/snponly.efi to aaaa:aaaa:aaaa::4<br>Jun 18 08:09:28 dnsmasq-tftp[11]: failed sending /var/lib/ironic/tftpboot/snponly.efi to aaaa:aaaa:aaaa::4<br>Jun 18 08:09:35 dnsmasq-tftp[11]: failed sending /var/lib/ironic/tftpboot/snponly.efi to aaaa:aaaa:aaaa::4<br></b><br></div><div dir="ltr">* Try to capture the TFTP traffic on br-ctlplane to a PCAP file to see</div><div><b>[Loke]:  </b></div><div><b>attached the same as aaaa.pcap</b></div><div><b><br></b></div><div><b>Also do note that there is a similar bug reported:</b></div><div><b><a href="https://bugs.launchpad.net/tripleo/+bug/1964397">https://bugs.launchpad.net/tripleo/+bug/1964397</a><br></b></div><div><b><br></b></div><div><b>the error in the bug is similar to what I have.</b></div><div><br></div><div dir="ltr"><br><br><div><br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Fri, Jun 17, 2022 at 5:53 PM Harald Jensas <<a href="mailto:hjensas@redhat.com">hjensas@redhat.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">Hi,<br>
<br>
The error in the screenshot, the booting node is not able to dowload the <br>
network boot program from the TFTP server on the undercloud.<br>
<br>
Can you:<br>
* Verify that the TFTP server is running?<br>
* Check the log file - /var/log/containers/ironic/dnsmasq.log<br>
* Try to capture the TFTP traffic on br-ctlplane to a PCAP file to see <br>
if we can use that to dignose the problem.<br>
* download that file manually?<br>
   For example: curl -O tftp://<undercloud_ip>/snponly.efi ?<br>
<br>
<br>
Best Regards<br>
Harald<br>
<br>
On 6/16/22 09:05, Lokendra Rathour wrote:<br>
> Hi Shephard,<br>
> Thanks, after changing the details as mentioned, Undercloud got <br>
> installed successfully.<br>
> Now as a part to test the introspection we added a single node and <br>
> initiated the introspection on which we are getting errors.<br>
> IP as per the inspector range is getting allocated, but soon after the <br>
> IP allocation the introspection ILO gives the below error:<br>
> image.png<br>
> it says, Downloading NBP file....<br>
> PXE-E99: Unexpected network error.<br>
> <br>
> Underlcoud.conf:<br>
> <br>
>     undercloud_debug = true<br>
>     clean_nodes = true<br>
>     cleanup = false<br>
>     container_cli = podman<br>
>     container_healthcheck_disabled = true<br>
>     container_images_file = /home/stack/containers-prepare-parameter.yaml<br>
>     deployment_user = stack<br>
>     enable_heat = true<br>
>     enable_ironic = true<br>
>     enable_ironic_inspector = true<br>
>     enable_neutron = true<br>
>     generate_service_certificate = false<br>
>     enable_routed_networks = false<br>
>     ipv6_address_mode = dhcpv6-stateful<br>
>     ipxe_enabled = true<br>
>     ironic_default_network_interface = neutron<br>
>     ironic_enabled_network_interfaces = neutron,flat<br>
>     local_interface = enp8s0<br>
>     local_ip = aaaa:aaaa:aaaa::1/64<br>
>     subnets = ctlplane-subnet<br>
>     undercloud_admin_host = aaaa:aaaa:aaaa::1<br>
>     undercloud_public_host = aaaa:aaaa:aaaa::1<br>
>     undercloud_hostname = <a href="http://undercloud.com" rel="noreferrer" target="_blank">undercloud.com</a> <<a href="http://undercloud.com" rel="noreferrer" target="_blank">http://undercloud.com</a>><br>
>     undercloud_ntp_servers = 30.30.30.3<br>
>     undercloud_timezone = UTC<br>
>     [ctlplane-subnet]<br>
>     cidr = aaaa:aaaa:aaaa::/64<br>
>     dhcp_end = aaaa:aaaa:aaaa::19<br>
>     dhcp_start = aaaa:aaaa:aaaa::5<br>
>     gateway = aaaa:aaaa:aaaa::1<br>
>     inspection_iprange = aaaa:aaaa:aaaa::20,aaaa:aaaa:aaaa::40<br>
> <br>
> <br>
> the ironic config in the container:<br>
> <br>
> [root@undercloud /]# vi /etc/ironic-inspector/dnsmasq.conf<br>
> port=0<br>
> interface=br-ctlplane<br>
> <br>
> dhcp-range=set:ctlplane-subnet,aaaa:aaaa:aaaa::20,aaaa:aaaa:aaaa::40,64,10m<br>
> dhcp-option-force=tag:ctlplane-subnet,option:mtu,1500<br>
> dhcp-sequential-ip<br>
> dhcp-match=ipxe,175<br>
> dhcp-match=set:efi,option:client-arch,7<br>
> dhcp-match=set:efi,option:client-arch,9<br>
> dhcp-match=set:efi,option:client-arch,11<br>
> # dhcpv6s for Client System Architecture Type (61)<br>
> dhcp-match=set:efi6,option6:61,0007<br>
> dhcp-match=set:efi6,option6:61,0009<br>
> dhcp-match=set:efi6,option6:61,0011<br>
> dhcp-userclass=set:ipxe6,iPXE<br>
> # Client is already running iPXE; move to next stage of chainloading<br>
> dhcp-boot=tag:ipxe,http://[aaaa:aaaa:aaaa::1]:8088/inspector.ipxe<br>
> dhcp-option=tag:ipxe6,option6:bootfile-url,http://[aaaa:aaaa:aaaa::1]:8088/inspector.ipxe<br>
> # Client is PXE booting over EFI without iPXE ROM; send EFI version of <br>
> iPXE chainloader<br>
> dhcp-boot=tag:efi,tag:!ipxe,snponly.efi<br>
> dhcp-option=tag:efi6,tag:!ipxe6,option6:bootfile-url,tftp://[aaaa:aaaa:aaaa::1]/snponly.efi<br>
> # Client is running PXE over BIOS; send BIOS version of iPXE chainloader<br>
> dhcp-boot=undionly.kpxe,localhost.localdomain,aaaa:aaaa:aaaa::1<br>
> <br>
> dhcp-hostsdir=/var/lib/ironic-inspector/dhcp-hostsdir<br>
> <br>
> <br>
> Please check and help me with the possible error and resolution.<br>
> <br>
> Best Regards,<br>
> Lokendra<br>
> <br>
> <br>
> <br>
> <br>
> On Thu, Jun 16, 2022 at 5:15 AM Brendan Shephard <<a href="mailto:bshephar@redhat.com" target="_blank">bshephar@redhat.com</a> <br>
> <mailto:<a href="mailto:bshephar@redhat.com" target="_blank">bshephar@redhat.com</a>>> wrote:<br>
> <br>
>     Hey,<br>
> <br>
>     Looks like that is the problem. The [ ] around the IP address are<br>
>     causing the issue. If I try to run dnsmasq using exactly the output<br>
>     you get, it gives me the same error:<br>
>     [root@tripleo-director ~]# /usr/sbin/dnsmasq --keep-in-foreground<br>
>     --log-facility=/var/log/ironic/dnsmasq.log --user=root<br>
>     --conf-file=/dev/null --listen-address=[aaaa:aaaa:aaaa::1] --port=0<br>
>     --enable-tftp --tftp-root=/var/lib/ironic/tftpboot<br>
> <br>
>     dnsmasq: bad command line options: try --help<br>
> <br>
>     VS without the [ ] I can see it starts up normally.<br>
> <br>
>     The settings in your undercloud.conf file look to be correct I<br>
>     believe. So I think there might be a bug here. I don't think we<br>
>     should be saving that value with the square brackets, or we would<br>
>     need to filter them out when we gather the value in that variable.<br>
> <br>
>     I raised a bug for it here so that we can dig into this and find<br>
>     what needs fixing:<br>
>     <a href="https://bugs.launchpad.net/tripleo/+bug/1978892" rel="noreferrer" target="_blank">https://bugs.launchpad.net/tripleo/+bug/1978892</a><br>
>     <<a href="https://bugs.launchpad.net/tripleo/+bug/1978892" rel="noreferrer" target="_blank">https://bugs.launchpad.net/tripleo/+bug/1978892</a>><br>
> <br>
>     In the meantime, if you edit that hieradata value, are you able to<br>
>     get that container started?<br>
> <br>
>     Change this:<br>
>     [root@tripleo-director ~]# egrep -r 'tftp_bind_host'<br>
>     /etc/puppet/hieradata/<br>
>     /etc/puppet/hieradata/service_configs.json:  <br>
>       "ironic::pxe::tftp_bind_host": "%{lookup('ctlplane_uri')}",<br>
> <br>
>     To this:<br>
>       "ironic::pxe::tftp_bind_host": "aaaa:aaaa:aaaa::1"<br>
> <br>
>     Then restart the service:<br>
>     sudo systemctl restart tripleo_ironic_pxe_http.service<br>
>     tripleo_ironic_pxe_tftp.service<br>
> <br>
>     Does that get the container running without the error? I did the<br>
>     same in my environment and can see that dnsmasq is running properly<br>
>     like that:<br>
>     [root@tripleo-director ~]# ps -ef | grep aaaa<br>
>     root       71180   52675  0 19:24 pts/4    00:00:00<br>
>     /usr/sbin/dnsmasq --keep-in-foreground<br>
>     --log-facility=/var/log/ironic/dnsmasq.log --user=root<br>
>     --conf-file=/dev/null --listen-address=aaaa:aaaa:aaaa::1 --port=0<br>
>     --enable-tftp --tftp-root=/var/lib/ironic/tftpboot<br>
> <br>
>     Brendan Shephard<br>
> <br>
>     Software Engineer<br>
> <br>
>     Red Hat APAC <<a href="https://www.redhat.com" rel="noreferrer" target="_blank">https://www.redhat.com</a>><br>
> <br>
>     193 N Quay<br>
> <br>
>     Brisbane City QLD 4000<br>
> <br>
>     @RedHat <<a href="https://twitter.com/redhat" rel="noreferrer" target="_blank">https://twitter.com/redhat</a>> Red Hat<br>
>     <<a href="https://www.linkedin.com/company/red-hat" rel="noreferrer" target="_blank">https://www.linkedin.com/company/red-hat</a>> Red Hat<br>
>     <<a href="https://www.facebook.com/RedHatInc" rel="noreferrer" target="_blank">https://www.facebook.com/RedHatInc</a>><br>
>     <<a href="https://red.ht/sig" rel="noreferrer" target="_blank">https://red.ht/sig</a>>      <br>
>     <<a href="https://redhat.com/summit" rel="noreferrer" target="_blank">https://redhat.com/summit</a>><br>
> <br>
> <br>
> <br>
>     On Thu, Jun 16, 2022 at 12:12 AM Lokendra Rathour<br>
>     <<a href="mailto:lokendrarathour@gmail.com" target="_blank">lokendrarathour@gmail.com</a> <mailto:<a href="mailto:lokendrarathour@gmail.com" target="_blank">lokendrarathour@gmail.com</a>>> wrote:<br>
> <br>
>         Hi Shephard,<br>
>         I am getting the local_ip (ipv6) of the undercloud :<br>
> <br>
>         [root@undercloud stack]# sudo hiera ironic::pxe::tftp_bind_host<br>
>         -c /etc/puppet/hiera.yaml<br>
>         [aaaa:aaaa:aaaa::1]<br>
> <br>
>         is this because of some ipv6 reasons?<br>
> <br>
> <br>
>         On Wed, Jun 15, 2022 at 6:08 PM Brendan Shephard<br>
>         <<a href="mailto:bshephar@redhat.com" target="_blank">bshephar@redhat.com</a> <mailto:<a href="mailto:bshephar@redhat.com" target="_blank">bshephar@redhat.com</a>>> wrote:<br>
> <br>
>             Hey,<br>
> <br>
>             Ok, that command looks fine. What about that variable there?<br>
>             Do you get anything back when you run:<br>
>             sudo hiera ironic::pxe::tftp_bind_host -c /etc/puppet/hiera.yaml<br>
> <br>
>             Mine returns:<br>
>             sudo hiera ironic::pxe::tftp_bind_host -c /etc/puppet/hiera.yaml<br>
>             192.168.24.115<br>
> <br>
>             Brendan Shephard<br>
> <br>
>             Software Engineer<br>
> <br>
>             Red Hat APAC <<a href="https://www.redhat.com" rel="noreferrer" target="_blank">https://www.redhat.com</a>><br>
> <br>
>             193 N Quay<br>
> <br>
>             Brisbane City QLD 4000<br>
> <br>
>             @RedHat <<a href="https://twitter.com/redhat" rel="noreferrer" target="_blank">https://twitter.com/redhat</a>> Red Hat<br>
>             <<a href="https://www.linkedin.com/company/red-hat" rel="noreferrer" target="_blank">https://www.linkedin.com/company/red-hat</a>> Red Hat<br>
>             <<a href="https://www.facebook.com/RedHatInc" rel="noreferrer" target="_blank">https://www.facebook.com/RedHatInc</a>><br>
>             <<a href="https://red.ht/sig" rel="noreferrer" target="_blank">https://red.ht/sig</a>>      <br>
>             <<a href="https://redhat.com/summit" rel="noreferrer" target="_blank">https://redhat.com/summit</a>><br>
> <br>
> <br>
> <br>
>             On Wed, Jun 15, 2022 at 8:20 PM Lokendra Rathour<br>
>             <<a href="mailto:lokendrarathour@gmail.com" target="_blank">lokendrarathour@gmail.com</a><br>
>             <mailto:<a href="mailto:lokendrarathour@gmail.com" target="_blank">lokendrarathour@gmail.com</a>>> wrote:<br>
> <br>
>                 Hi Shephard,<br>
> <br>
>                 this is the command from my wallaby:<br>
>                 [root@undercloud ~]# sudo cat<br>
>                 /var/lib/tripleo-config/container-startup-config/step_4/ironic_pxe_tftp.json<br>
>                 {<br>
>                    "cap_add": [<br>
>                      "NET_ADMIN",<br>
>                      "NET_RAW",<br>
>                      "SETUID"<br>
>                    ],<br>
>                    "command": [<br>
>                      "/bin/bash",<br>
>                      "-c",<br>
>                      "BIND_HOST=$(hiera ironic::pxe::tftp_bind_host -c<br>
>                 /etc/puppet/hiera.yaml); /usr/sbin/dnsmasq<br>
>                 --keep-in-foreground<br>
>                 --log-facility=/var/log/ironic/dnsmasq.log --user=root<br>
>                 --conf-file=/dev/null --listen-address=$BIND_HOST<br>
>                 --port=0 --enable-tftp --tftp-root=/var/lib/ironic/tftpboot"<br>
>                    ],<br>
>                    "environment": {<br>
>                      "KOLLA_CONFIG_STRATEGY": "COPY_ALWAYS",<br>
>                      "TRIPLEO_CONFIG_HASH":<br>
>                 "9fb3e4e0e35ee35fdf74cfccb16a7543"<br>
>                    },<br>
>                    "healthcheck": {<br>
>                      "test": "/openstack/healthcheck"<br>
>                    },<br>
>                    "image":<br>
>                 "undercloud.ctlplane.localdomain:8787/tripleowallaby/openstack-ironic-pxe:current-tripleo",<br>
>                    "net": "host",<br>
>                    "privileged": false,<br>
>                    "restart": "always",<br>
>                    "start_order": 90,<br>
>                    "volumes": [<br>
>                      "/etc/hosts:/etc/hosts:ro",<br>
>                      "/etc/localtime:/etc/localtime:ro",<br>
>                     <br>
>                 "/etc/pki/ca-trust/extracted:/etc/pki/ca-trust/extracted:ro",<br>
>                     <br>
>                 "/etc/pki/ca-trust/source/anchors:/etc/pki/ca-trust/source/anchors:ro",<br>
>                     <br>
>                 "/etc/pki/tls/certs/ca-bundle.crt:/etc/pki/tls/certs/ca-bundle.crt:ro",<br>
>                     <br>
>                 "/etc/pki/tls/certs/ca-bundle.trust.crt:/etc/pki/tls/certs/ca-bundle.trust.crt:ro",<br>
>                      "/etc/pki/tls/cert.pem:/etc/pki/tls/cert.pem:ro",<br>
>                      "/dev/log:/dev/log",<br>
>                      "/etc/puppet:/etc/puppet:ro",<br>
>                     <br>
>                 "/var/lib/kolla/config_files/ironic_pxe_tftp.json:/var/lib/kolla/config_files/config.json:ro",<br>
>                     <br>
>                 "/var/lib/config-data/puppet-generated/ironic:/var/lib/kolla/config_files/src:ro",<br>
>                      "/var/lib/ironic:/var/lib/ironic:shared,z",<br>
>                      "/var/log/containers/ironic:/var/log/ironic:z",<br>
>                      "/var/log/containers/httpd/ironic-pxe:/var/log/httpd:z"<br>
>                    ]<br>
>                 }[root@undercloud ~]#<br>
> <br>
>                 Comparing both, they look alike.<br>
>                 please check once.<br>
> <br>
>                 On Wed, Jun 15, 2022 at 3:30 PM Brendan Shephard<br>
>                 <<a href="mailto:bshephar@redhat.com" target="_blank">bshephar@redhat.com</a> <mailto:<a href="mailto:bshephar@redhat.com" target="_blank">bshephar@redhat.com</a>>> wrote:<br>
> <br>
>                     Hi,<br>
> <br>
>                     Looks like the command was in a different file in<br>
>                     Wallaby, can you check:<br>
>                     sudo cat<br>
>                     /var/lib/tripleo-config/container-startup-config/step_4/ironic_pxe_tftp.json<br>
> <br>
>                     That one should have the dnsmasq command it's trying<br>
>                     to run. For example, here it is from my Wallaby<br>
>                     environment:<br>
>                     [stack@undercloud-0 ~]$ sudo cat<br>
>                     /var/lib/tripleo-config/container-startup-config/step_4/ironic_pxe_tftp.json<br>
>                     | jq .command<br>
>                     [<br>
>                        "/bin/bash",<br>
>                        "-c",<br>
>                        "BIND_HOST=$(hiera ironic::pxe::tftp_bind_host -c<br>
>                     /etc/puppet/hiera.yaml); /usr/sbin/dnsmasq<br>
>                     --keep-in-foreground<br>
>                     --log-facility=/var/log/ironic/dnsmasq.log<br>
>                     --user=root --conf-file=/dev/null<br>
>                     --listen-address=$BIND_HOST --port=0 --enable-tftp<br>
>                     --tftp-root=/var/lib/ironic/tftpboot"<br>
>                     ]<br>
> <br>
> <br>
> <br>
>                     Brendan Shephard<br>
> <br>
>                     Software Engineer<br>
> <br>
>                     Red Hat APAC <<a href="https://www.redhat.com" rel="noreferrer" target="_blank">https://www.redhat.com</a>><br>
> <br>
>                     193 N Quay<br>
> <br>
>                     Brisbane City QLD 4000<br>
> <br>
>                     @RedHat <<a href="https://twitter.com/redhat" rel="noreferrer" target="_blank">https://twitter.com/redhat</a>> Red Hat<br>
>                     <<a href="https://www.linkedin.com/company/red-hat" rel="noreferrer" target="_blank">https://www.linkedin.com/company/red-hat</a>> Red Hat<br>
>                     <<a href="https://www.facebook.com/RedHatInc" rel="noreferrer" target="_blank">https://www.facebook.com/RedHatInc</a>><br>
>                     <<a href="https://red.ht/sig" rel="noreferrer" target="_blank">https://red.ht/sig</a>>      <br>
>                     <<a href="https://redhat.com/summit" rel="noreferrer" target="_blank">https://redhat.com/summit</a>><br>
> <br>
> <br>
> <br>
>                     On Wed, Jun 15, 2022 at 7:19 PM Lokendra Rathour<br>
>                     <<a href="mailto:lokendrarathour@gmail.com" target="_blank">lokendrarathour@gmail.com</a><br>
>                     <mailto:<a href="mailto:lokendrarathour@gmail.com" target="_blank">lokendrarathour@gmail.com</a>>> wrote:<br>
> <br>
>                         Hi Shephard,<br>
>                         Here is the o/p of the file:<br>
> <br>
>                         [root@undercloud ~]# sudo cat<br>
>                         /var/lib/kolla/config_files/ironic_pxe_tftp.json<br>
>                         {<br>
>                            "config_files": [<br>
>                              {<br>
>                                "dest": "/",<br>
>                                "merge": true,<br>
>                                "preserve_properties": true,<br>
>                                "source": "/var/lib/kolla/config_files/src/*"<br>
>                              }<br>
>                            ],<br>
>                            "permissions": [<br>
>                              {<br>
>                                "owner": "ironic:ironic",<br>
>                                "path": "/var/log/ironic",<br>
>                                "recurse": true<br>
>                              },<br>
>                              {<br>
>                                "owner": "ironic:ironic",<br>
>                                "path": "/var/lib/ironic",<br>
>                                "recurse": true<br>
>                              }<br>
>                            ]<br>
>                         }[root@undercloud ~]#<br>
> <br>
> <br>
>                         Thanks once agan.<br>
> <br>
>                         -Lokendra<br>
> <br>
> <br>
>                         On Wed, Jun 15, 2022 at 2:38 PM Brendan Shephard<br>
>                         <<a href="mailto:bshephar@redhat.com" target="_blank">bshephar@redhat.com</a><br>
>                         <mailto:<a href="mailto:bshephar@redhat.com" target="_blank">bshephar@redhat.com</a>>> wrote:<br>
> <br>
>                             Looks like something wrong with the dnsmasq<br>
>                             command the container is being launched<br>
>                             with. What command is it trying to run?<br>
> <br>
>                             sudo cat<br>
>                             /var/lib/kolla/config_files/ironic_pxe_tftp.json<br>
> <br>
>                             Brendan Shephard<br>
> <br>
>                             Software Engineer<br>
> <br>
>                             Red Hat APAC <<a href="https://www.redhat.com" rel="noreferrer" target="_blank">https://www.redhat.com</a>><br>
> <br>
>                             193 N Quay<br>
> <br>
>                             Brisbane City QLD 4000<br>
> <br>
>                             @RedHat <<a href="https://twitter.com/redhat" rel="noreferrer" target="_blank">https://twitter.com/redhat</a>> Red Hat<br>
>                             <<a href="https://www.linkedin.com/company/red-hat" rel="noreferrer" target="_blank">https://www.linkedin.com/company/red-hat</a>><br>
>                             Red Hat <<a href="https://www.facebook.com/RedHatInc" rel="noreferrer" target="_blank">https://www.facebook.com/RedHatInc</a>><br>
>                             <<a href="https://red.ht/sig" rel="noreferrer" target="_blank">https://red.ht/sig</a>>      <br>
>                             <<a href="https://redhat.com/summit" rel="noreferrer" target="_blank">https://redhat.com/summit</a>><br>
> <br>
> <br>
> <br>
>                             On Wed, Jun 15, 2022 at 6:22 PM Anirudh<br>
>                             Gupta <<a href="mailto:anyrude10@gmail.com" target="_blank">anyrude10@gmail.com</a><br>
>                             <mailto:<a href="mailto:anyrude10@gmail.com" target="_blank">anyrude10@gmail.com</a>>> wrote:<br>
> <br>
>                                 Hi Brendan,<br>
> <br>
>                                 Thanks for your response.<br>
> <br>
>                                 Please find the log below.<br>
> <br>
>                                 [stack@undercloud t2u2v2w]$ sudo podman<br>
>                                 logs ironic_pxe_tftp<br>
> <br>
>                                 dnsmasq: bad command line options: try<br>
>                                 --help<br>
>                                 dnsmasq: bad command line options: try<br>
>                                 --help<br>
>                                 dnsmasq: bad command line options: try<br>
>                                 --help<br>
>                                 dnsmasq: bad command line options: try<br>
>                                 --help<br>
>                                 dnsmasq: bad command line options: try<br>
>                                 --help<br>
>                                 dnsmasq: bad command line options: try<br>
>                                 --help<br>
> <br>
>                                 [stack@undercloud t2u2v2w]$  sudo podman<br>
>                                 ps --filter name=ironic_pxe -a<br>
>                                 CONTAINER ID  IMAGE                    <br>
>                                                                         <br>
>                                                          COMMAND        <br>
>                                        CREATED      STATUS              <br>
>                                                 PORTS       NAMES<br>
>                                 02dacbc74cec<br>
>                                   undercloud.ctlplane.localdomain:8787/tripleowallaby/openstack-ironic-pxe:current-tripleo  /bin/bash -c BIND...  3 hours ago  Exited (1) 3 hours ago (unhealthy)              ironic_pxe_tftp<br>
>                                 1f8ca39fba32<br>
>                                   undercloud.ctlplane.localdomain:8787/tripleowallaby/openstack-ironic-pxe:current-tripleo  kolla_start           3 hours ago  Up 3 hours ago (healthy)                        ironic_pxe_http<br>
> <br>
> <br>
>                                 Regards<br>
> <br>
>                                 Anirudh Gupta<br>
> <br>
> <br>
>                                 On Wed, Jun 15, 2022 at 11:30 AM Brendan<br>
>                                 Shephard <<a href="mailto:bshephar@redhat.com" target="_blank">bshephar@redhat.com</a><br>
>                                 <mailto:<a href="mailto:bshephar@redhat.com" target="_blank">bshephar@redhat.com</a>>> wrote:<br>
> <br>
>                                     Hey Anirudh,<br>
> <br>
>                                     You would need to look at the logs<br>
>                                     for the ironic_pxe_tftp container to<br>
>                                     see why it's failing.<br>
> <br>
>                                     I assume the tftp container is not<br>
>                                     Up when you run this command?<br>
>                                     [stack@tripleo-director<br>
>                                     overcloud_playbooks]$ sudo podman ps<br>
>                                     --filter name=ironic_pxe -a<br>
>                                     CONTAINER ID  IMAGE                <br>
>                                                                         <br>
>                                                                       <br>
>                                     COMMAND      CREATED      STATUS    <br>
>                                                      PORTS       NAMES<br>
>                                     0170be36e291<br>
>                                     <a href="http://registry.okd4.bne-shift.net:8443/tripleomastercentos9/openstack-ironic-pxe:current-tripleo" rel="noreferrer" target="_blank">registry.okd4.bne-shift.net:8443/tripleomastercentos9/openstack-ironic-pxe:current-tripleo</a><br>
>                                     <<a href="http://registry.okd4.bne-shift.net:8443/tripleomastercentos9/openstack-ironic-pxe:current-tripleo" rel="noreferrer" target="_blank">http://registry.okd4.bne-shift.net:8443/tripleomastercentos9/openstack-ironic-pxe:current-tripleo</a>><br>
>                                       kolla_start  12 days ago  Up 30<br>
>                                     hours ago (healthy)            <br>
>                                       ironic_pxe_tftp<br>
>                                     e507f722bdf0<br>
>                                     <a href="http://registry.okd4.bne-shift.net:8443/tripleomastercentos9/openstack-ironic-pxe:current-tripleo" rel="noreferrer" target="_blank">registry.okd4.bne-shift.net:8443/tripleomastercentos9/openstack-ironic-pxe:current-tripleo</a><br>
>                                     <<a href="http://registry.okd4.bne-shift.net:8443/tripleomastercentos9/openstack-ironic-pxe:current-tripleo" rel="noreferrer" target="_blank">http://registry.okd4.bne-shift.net:8443/tripleomastercentos9/openstack-ironic-pxe:current-tripleo</a>><br>
>                                       kolla_start  12 days ago  Up 30<br>
>                                     hours ago (healthy)            <br>
>                                       ironic_pxe_http<br>
> <br>
>                                     Then check the logs to see what the<br>
>                                     error is:<br>
>                                     [stack@tripleo-director<br>
>                                     overcloud_playbooks]$ sudo podman<br>
>                                     logs ironic_pxe_tftp<br>
> <br>
> <br>
> <br>
>                                     Brendan Shephard<br>
> <br>
>                                     Software Engineer<br>
> <br>
>                                     Red Hat APAC <<a href="https://www.redhat.com" rel="noreferrer" target="_blank">https://www.redhat.com</a>><br>
> <br>
>                                     193 N Quay<br>
> <br>
>                                     Brisbane City QLD 4000<br>
> <br>
>                                     @RedHat <<a href="https://twitter.com/redhat" rel="noreferrer" target="_blank">https://twitter.com/redhat</a>><br>
>                                     Red Hat<br>
>                                     <<a href="https://www.linkedin.com/company/red-hat" rel="noreferrer" target="_blank">https://www.linkedin.com/company/red-hat</a>><br>
>                                     Red Hat<br>
>                                     <<a href="https://www.facebook.com/RedHatInc" rel="noreferrer" target="_blank">https://www.facebook.com/RedHatInc</a>><br>
>                                     <<a href="https://red.ht/sig" rel="noreferrer" target="_blank">https://red.ht/sig</a>>      <br>
>                                     <<a href="https://redhat.com/summit" rel="noreferrer" target="_blank">https://redhat.com/summit</a>><br>
> <br>
> <br>
> <br>
>                                     On Wed, Jun 15, 2022 at 7:53 AM<br>
>                                     Anirudh Gupta <<a href="mailto:anyrude10@gmail.com" target="_blank">anyrude10@gmail.com</a><br>
>                                     <mailto:<a href="mailto:anyrude10@gmail.com" target="_blank">anyrude10@gmail.com</a>>> wrote:<br>
> <br>
>                                         Hi Team,<br>
> <br>
>                                         I am trying to deploy Openstack<br>
>                                         Wallaby Undercloud on IPv6, but<br>
>                                         facing the below error:<br>
> <br>
>                                         2022-06-14 05:01:23.213708 |<br>
>                                         52540083-cfa2-3f20-e9dc-00000000286f<br>
>                                         | TASK | Manage container<br>
>                                         systemd services and cleanup old<br>
>                                         systemd healthchecks for<br>
>                                         /var/lib/tripleo-config/container-startup-config/step_4<br>
>                                         2022-06-14 05:03:22.912816 |<br>
>                                         52540083-cfa2-3f20-e9dc-00000000286f<br>
>                                         | FATAL | Manage container<br>
>                                         systemd services and cleanup old<br>
>                                         systemd healthchecks for<br>
>                                         /var/lib/tripleo-config/container-startup-config/step_4<br>
>                                         | undercloud | error={"changed":<br>
>                                         false, "msg": "Service<br>
>                                         ironic_pxe_tftp has not started<br>
>                                         yet"}<br>
>                                         2022-06-14 05:03:22.914400 |<br>
>                                         52540083-cfa2-3f20-e9dc-00000000286f<br>
>                                         | TIMING |<br>
>                                         tripleo_container_manage :<br>
>                                         Manage container systemd<br>
> <br>
>                                         Sample Undercloud.conf is as<br>
>                                         follows:<br>
> <br>
>                                         [DEFAULT]<br>
>                                         clean_nodes = true<br>
>                                         cleanup = false<br>
>                                         container_cli = podman<br>
>                                         container_healthcheck_disabled =<br>
>                                         true<br>
>                                         container_images_file =<br>
>                                         /home/stack/containers-prepare-parameter.yaml<br>
>                                         deployment_user = stack<br>
>                                         enable_ironic = true<br>
>                                         enable_ironic_inspector = true<br>
>                                         enable_neutron = true<br>
>                                         enable_routed_networks = false<br>
>                                         generate_service_certificate = false<br>
>                                         ipv6_address_mode = dhcpv6-stateful<br>
>                                         ipxe_enabled = true<br>
>                                         local_interface = enp8s0<br>
>                                         local_ip = aaaa:aaaa:aaaa::1/64<br>
>                                         subnets = ctlplane-subnet<br>
>                                         undercloud_admin_host =<br>
>                                         aaaa:aaaa:aaaa::1<br>
>                                         undercloud_hostname =<br>
>                                         <a href="http://undercloud.com" rel="noreferrer" target="_blank">undercloud.com</a><br>
>                                         <<a href="http://undercloud.com" rel="noreferrer" target="_blank">http://undercloud.com</a>><br>
>                                         undercloud_ntp_servers = 30.30.30.3<br>
>                                         undercloud_public_host =<br>
>                                         aaaa:aaaa:aaaa::1<br>
>                                         undercloud_timezone = UTC<br>
> <br>
>                                         [ctlplane-subnet]<br>
>                                         cidr = aaaa:aaaa:aaaa::/64<br>
>                                         dhcp_end = aaaa:aaaa:aaaa::f<br>
>                                         dhcp_start = aaaa:aaaa:aaaa::a<br>
>                                         gateway = aaaa:aaaa:aaaa::1<br>
>                                         inspection_iprange =<br>
>                                         aaaa:aaaa:aaaa::3,aaaa:aaaa:aaaa::9<br>
> <br>
>                                         Can someone please help in this<br>
>                                         regard.<br>
> <br>
>                                         Anirudh Gupta<br>
> <br>
> <br>
> <br>
>                         -- <br>
>                         ~ Lokendra<br>
>                         <a href="http://www.inertiaspeaks.com" rel="noreferrer" target="_blank">www.inertiaspeaks.com</a> <<a href="http://www.inertiaspeaks.com" rel="noreferrer" target="_blank">http://www.inertiaspeaks.com</a>><br>
>                         <a href="http://www.inertiagroups.com" rel="noreferrer" target="_blank">www.inertiagroups.com</a> <<a href="http://www.inertiagroups.com" rel="noreferrer" target="_blank">http://www.inertiagroups.com</a>><br>
>                         skype: lokendrarathour<br>
> <br>
> <br>
> <br>
> <br>
>                 -- <br>
>                 ~ Lokendra<br>
>                 <a href="http://www.inertiaspeaks.com" rel="noreferrer" target="_blank">www.inertiaspeaks.com</a> <<a href="http://www.inertiaspeaks.com" rel="noreferrer" target="_blank">http://www.inertiaspeaks.com</a>><br>
>                 <a href="http://www.inertiagroups.com" rel="noreferrer" target="_blank">www.inertiagroups.com</a> <<a href="http://www.inertiagroups.com" rel="noreferrer" target="_blank">http://www.inertiagroups.com</a>><br>
>                 skype: lokendrarathour<br>
> <br>
> <br>
> <br>
> <br>
>         -- <br>
>         ~ Lokendra<br>
>         <a href="http://www.inertiaspeaks.com" rel="noreferrer" target="_blank">www.inertiaspeaks.com</a> <<a href="http://www.inertiaspeaks.com" rel="noreferrer" target="_blank">http://www.inertiaspeaks.com</a>><br>
>         <a href="http://www.inertiagroups.com" rel="noreferrer" target="_blank">www.inertiagroups.com</a> <<a href="http://www.inertiagroups.com" rel="noreferrer" target="_blank">http://www.inertiagroups.com</a>><br>
>         skype: lokendrarathour<br>
> <br>
> <br>
> <br>
> <br>
> -- <br>
> ~ Lokendra<br>
> <a href="http://www.inertiaspeaks.com" rel="noreferrer" target="_blank">www.inertiaspeaks.com</a> <<a href="http://www.inertiaspeaks.com" rel="noreferrer" target="_blank">http://www.inertiaspeaks.com</a>><br>
> <a href="http://www.inertiagroups.com" rel="noreferrer" target="_blank">www.inertiagroups.com</a> <<a href="http://www.inertiagroups.com" rel="noreferrer" target="_blank">http://www.inertiagroups.com</a>><br>
> skype: lokendrarathour<br>
> <br>
> <br>
<br>
</blockquote></div><br clear="all"><div><br></div>-- <br><div dir="ltr" class="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div dir="ltr">~ Lokendra</div><div dir="ltr"><a href="http://www.inertiaspeaks.com" target="_blank">www.inertiaspeaks.com</a></div><div dir="ltr"><a href="http://www.inertiagroups.com" target="_blank">www.inertiagroups.com</a></div><div>skype: lokendrarathour</div><div dir="ltr"><img width="200" height="41" src="https://ci3.googleusercontent.com/mail-sig/AIorK4zyd6LpJOGqagxmzUlY59eMQx0-FN0t8HtjdtGE7VLZSKIxBUz3bI7z-MBqbgDVg1-XbtvHgN_ATJ10N6bonyO-JSGTtl5s_mNSbDoXBg"><br></div><div dir="ltr"><br></div></div></div></div></div></div>