<div dir="ltr">Hi,<div>Here is the output as requested:</div><div><br></div><div>[root@undercloud ~]# sudo podman inspect ironic_pxe_tftp | jq .[].Config.Labels<br>{<br> "architecture": "x86_64",<br> "build-date": "2020-09-01T19:43:46.041620",<br> "com.redhat.build-host": "<a href="http://cpt-1008.osbs.prod.upshift.rdu2.redhat.com">cpt-1008.osbs.prod.upshift.rdu2.redhat.com</a>",<br> "com.redhat.component": "ubi8-container",<br> "com.redhat.license_terms": "<a href="https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI">https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI</a>",<br> "config_data": "{'command': ['/bin/bash', '-c', 'BIND_HOST=$(hiera ironic::pxe::tftp_bind_host -c /etc/puppet/hiera.yaml); /usr/sbin/in.tftpd --foreground --user root --address $BIND_HOST:69 --map-file /var/lib/ironic/tftpboot/map-file /var/lib/ironic/tftpboot'], 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'TRIPLEO_CONFIG_HASH': '669301f635becb3ecffd248a4ac56f35'}, 'healthcheck': {'test': '/openstack/healthcheck'}, 'image': '<a href="http://undercloud.ctlplane.taashee.com:8787/tripleowallaby/openstack-ironic-pxe:current-tripleo">undercloud.ctlplane.taashee.com:8787/tripleowallaby/openstack-ironic-pxe:current-tripleo</a>', 'net': 'host', 'privileged': False, 'restart': 'always', 'start_order': 90, 'volumes': ['/etc/hosts:/etc/hosts:ro', '/etc/localtime:/etc/localtime:ro', '/etc/pki/ca-trust/extracted:/etc/pki/ca-trust/extracted:ro', '/etc/pki/ca-trust/source/anchors:/etc/pki/ca-trust/source/anchors:ro', '/etc/pki/tls/certs/ca-bundle.crt:/etc/pki/tls/certs/ca-bundle.crt:ro', '/etc/pki/tls/certs/ca-bundle.trust.crt:/etc/pki/tls/certs/ca-bundle.trust.crt:ro', '/etc/pki/tls/cert.pem:/etc/pki/tls/cert.pem:ro', '/dev/log:/dev/log', '/etc/puppet:/etc/puppet:ro', '/var/lib/kolla/config_files/ironic_pxe_tftp.json:/var/lib/kolla/config_files/config.json:ro', '/var/lib/config-data/puppet-generated/ironic:/var/lib/kolla/config_files/src:ro', '/var/lib/ironic:/var/lib/ironic/:shared,z', '/var/log/containers/ironic:/var/log/ironic:z', '/var/log/containers/httpd/ironic-pxe:/var/log/httpd:z']}",<br> "config_id": "tripleo_step4",<br> "container_name": "ironic_pxe_tftp",<br> "description": "The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly.",<br> "distribution-scope": "public",<br> "io.buildah.version": "1.19.9",<br> "io.k8s.description": "The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly.",<br> "io.k8s.display-name": "Red Hat Universal Base Image 8",<br> "io.openshift.expose-services": "",<br> "io.openshift.tags": "base rhel8",<br> "maintainer": "OpenStack TripleO team",<br> "managed_by": "tripleo_ansible",<br> "name": "ubi8",<br> "release": "347",<br> "summary": "Provides the latest release of Red Hat Universal Base Image 8.",<br> "tcib_managed": "true",<br> "url": "<a href="https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.2-347">https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.2-347</a>",<br> "vcs-ref": "663db861f0ff7a9c526c1c169a62c14c01a32dcc",<br> "vcs-type": "git",<br> "vendor": "Red Hat, Inc.",<br> "version": "8.2"<br>}<br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Tue, Jul 5, 2022 at 11:59 AM Brendan Shephard <<a href="mailto:bshephar@redhat.com">bshephar@redhat.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">Hey,<br><br>The tripleowallaby containers are all built on ubi8 at the moment:<br><span style="font-family:monospace"><span style="color:rgb(95,215,0)">❯</span><span style="color:rgb(0,0,0)"> </span><span style="color:rgb(24,178,24)">skopeo</span><span style="color:rgb(0,0,0)"> inspect docker://<a href="http://quay.io/tripleowallaby/openstack-ironic-base:current-tripleo" target="_blank">quay.io/tripleowallaby/openstack-ironic-base:current-tripleo</a> | </span><span style="color:rgb(24,178,24)">jq</span><span style="color:rgb(0,0,0)"> .Labels.name
</span><br><span style="color:rgb(24,178,24)">"ubi8"</span></span><div><span style="font-family:monospace"><font color="#18b218"><br></font></span></div><div><font color="#000000" face="arial, sans-serif">The container image should be ok. </font><font face="arial, sans-serif">If it isn't an environmental issue, we should be seeing the same problem in our CI environments. Wallaby in particular is getting a lot of attention in our CI environments at the moment.<br></font><br>Are you able to inspect the container and share the output?<br><span style="font-family:monospace"><span style="color:rgb(0,0,0)">sudo podman inspect ironic_pxe_tftp | jq .[].Config.Labels</span></span><div><div dir="ltr"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><p style="font-weight:bold;margin:0px;padding:0px;font-size:14px;text-transform:capitalize;font-family:RedHatText,sans-serif"><span><br><br>Brendan</span> <span>Shephard</span><span style="color:rgb(170,170,170);margin:0px"></span>
</p>
<p style="font-weight:normal;font-size:12px;margin:0px;text-transform:capitalize;font-family:RedHatText,sans-serif">
<span>Software Engineer</span>
</p>
<p style="font-weight:normal;margin:0px 0px 4px;font-size:12px;font-family:RedHatText,sans-serif">
<a style="color:rgb(0,136,206);font-size:12px;margin:0px;text-decoration:none;font-family:RedHatText,sans-serif" href="https://www.redhat.com" target="_blank">Red Hat <span>APAC</span></a>
</p>
<div style="margin-bottom:4px">
<span>
<p style="font-size:12px;margin:0px;font-family:RedHatText,sans-serif">193 N Quay</p>
</span>
<span>
<p style="font-size:12px;margin:0px;font-family:RedHatText,sans-serif">Brisbane City QLD 4000</p>
</span>
</div>
<div style="font-weight:normal;font-size:12px;font-family:RedHatText,sans-serif;margin-bottom:8px">
<div>
<a href="https://twitter.com/redhat" title="twitter" style="background:url("https://marketing-outfit-prod-images.s3-us-west-2.amazonaws.com/3780bd4ede961ef3cd4108b8c0e80186/web-icon-twitter.png") 0px 50%/13px no-repeat scroll transparent;text-decoration:none;color:rgb(0,0,0);display:inline-block;line-height:20px;padding-left:13px" target="_blank">
<span style="margin-left:2px">@RedHat</span>
</a>
<a href="https://www.linkedin.com/company/red-hat" title="LinkedIn" style="background:url("https://marketing-outfit-prod-images.s3-us-west-2.amazonaws.com/8d3507e3c6b6c9ad10e301accf1a4af0/web-icon-linkedin.png") 0px 50%/12px no-repeat scroll transparent;text-decoration:none;color:rgb(0,0,0);display:inline-block;line-height:20px;padding-left:12px;margin:0px 4px 0px 3px;padding-top:1px" target="_blank">
<span style="margin-left:4px">Red Hat</span>
</a>
<a href="https://www.facebook.com/RedHatInc" title="Facebook" style="background:url("https://marketing-outfit-prod-images.s3-us-west-2.amazonaws.com/220b85e2f100025e94cb1bcd993bd51d/web-icon-facebook.png") 0px 50%/11px no-repeat scroll transparent;text-decoration:none;color:rgb(0,0,0);display:inline-block;line-height:20px;padding-left:13px" target="_blank">
<span>Red Hat</span>
</a>
</div>
</div>
<div style="margin-top:12px">
<table border="0">
<tbody><tr>
<td width="100px"><a href="https://red.ht/sig" target="_blank"> <img src="https://static.redhat.com/libs/redhat/brand-assets/latest/corp/logo.png" width="90" height="auto"></a> </td>
<td style="font-weight:normal;font-size:12px">
<div><a href="https://redhat.com/summit" style="text-decoration:none" target="_blank"><img style="outline: currentcolor none 0px;" src="https://static.redhat.com/libs/redhat/brand-assets/latest/events/red-hat-summit.png" width="53px" height="auto"></a></div>
</td>
</tr>
</tbody></table>
</div>
</div><span></span></div></div></div></div></div></div></div></div></div></div></div><br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Tue, Jul 5, 2022 at 3:39 PM Swogat Pradhan <<a href="mailto:swogatpradhan22@gmail.com" target="_blank">swogatpradhan22@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">I had used the namespace: <a href="http://quay.io/tripleowallaby" target="_blank">quay.io/tripleowallaby</a> where I faced this issue.<div>Which is why i started this thread.</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Tue, Jul 5, 2022 at 11:06 AM Takashi Kajinami <<a href="mailto:tkajinam@redhat.com" target="_blank">tkajinam@redhat.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div>Can you try</div><div><br></div><div> namespace: <a href="http://quay.io/tripleowallaby" target="_blank">quay.io/tripleowallaby</a></div><div><br></div><div>instead ?</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Tue, Jul 5, 2022 at 2:27 PM Swogat Pradhan <<a href="mailto:swogatpradhan22@gmail.com" target="_blank">swogatpradhan22@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><p style="margin:0px 0px 0.8em;padding:0px;width:auto;max-width:45em;color:rgb(51,51,51);font-family:monospace;font-size:12px">i believe that is the issue, the current continer parameters file is trying to pull centos9 images.<br>i changed the namespace, but i was unable to find the <a href="http://quay.io/tripleowallaby,iiuc" target="_blank">quay.io/tripleowallaby,iiuc</a> in web, honestly i don't know ow to specify that:<br>(undercloud) [stack@undercloud ~]$ cat containers-prepare-parameter.yaml<br># Generated with the following on 2022-07-04T13:53:39.943715<br>#<br># openstack tripleo container image prepare default --local-push-destination --output-env-file containers-prepare-parameter.yaml<br>#</p><p id="gmail-m_90872222127367107gmail-m_-8323242785442494385gmail-m_5104585429604064495gmail-m_-841505845731945438gmail-yui_3_10_3_1_1656996892153_2033" style="margin:0px 0px 0.8em;padding:0px;width:auto;max-width:45em;color:rgb(51,51,51);font-family:monospace;font-size:12px">parameter_defaults:<br> ContainerImagePrepare:<br> - push_destination: true<br> set:<br> ceph_alertmanager_image: alertmanager<br> ceph_alertmanager_namespace: <a href="http://quay.ceph.io/prometheus" target="_blank">quay.ceph.io/prometheus</a><br> ceph_alertmanager_tag: v0.16.2<br> ceph_grafana_image: grafana<br> ceph_grafana_namespace: <a href="http://quay.ceph.io/app-sre" target="_blank">quay.ceph.io/app-sre</a><br> ceph_grafana_tag: 6.7.4<br> ceph_image: daemon<br> ceph_namespace: <a href="http://quay.io/ceph" target="_blank">quay.io/ceph</a><br> ceph_node_exporter_image: node-exporter<br> ceph_node_exporter_namespace: <a href="http://quay.ceph.io/prometheus" target="_blank">quay.ceph.io/prometheus</a><br> ceph_node_exporter_tag: v0.17.0<br> ceph_prometheus_image: prometheus<br> ceph_prometheus_namespace: <a href="http://quay.ceph.io/prometheus" target="_blank">quay.ceph.io/prometheus</a><br> ceph_prometheus_tag: v2.7.2<br> ceph_tag: v6.0.4-stable-6.0-pacific-centos-8-x86_64<br> name_prefix: openstack-<br> name_suffix: ''<br> namespace: <a href="http://quay.io/tripleowallaby,iiuc" target="_blank">quay.io/tripleowallaby,iiuc</a><br> neutron_driver: ovn<br> rhel_containers: false<br> tag: current-tripleo<br> tag_from_label: rdo_version</p><p style="margin:0px 0px 0.8em;padding:0px;width:auto;max-width:45em;color:rgb(51,51,51);font-family:monospace;font-size:12px">Is this how to specify it?</p></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Tue, Jul 5, 2022 at 10:12 AM Takashi Kajinami <<a href="mailto:tkajinam@redhat.com" target="_blank">tkajinam@redhat.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div> > The error indicates that you are running c9s containers on c8s containers.</div><div>I mean to say</div><div><br></div><div>c9s containers on c8s <b>hosts</b>.<br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Tue, Jul 5, 2022 at 1:41 PM Takashi Kajinami <<a href="mailto:tkajinam@redhat.com" target="_blank">tkajinam@redhat.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div>The error indicates that you are running c9s containers on c8s containers.</div><div>I'd suggest you check your ContainParameterParameters and ensure you are pulling</div><div>the correct image (wallaby + centos 8 stream).<br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Tue, Jul 5, 2022 at 1:12 PM Swogat Pradhan <<a href="mailto:swogatpradhan22@gmail.com" target="_blank">swogatpradhan22@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><p style="margin:0px 0px 1.2em;padding:0px;width:auto;max-width:45em;color:rgb(51,51,51);font-family:monospace;font-size:12px">Hi,<br>I am trying to setup openstack wallaby using the repo : centos-release-openstack-wallaby on top of centos 8 stream.</p><p style="margin:0px 0px 1.2em;padding:0px;width:auto;max-width:45em;color:rgb(51,51,51);font-family:monospace;font-size:12px">I have deployed undercloud but the service ironic_pxe_tftp is not starting up. Previously the undercloud was failing but now the undercloud is deployed successfully but the service is not coming up.</p><p style="margin:0px 0px 1.2em;padding:0px;width:auto;max-width:45em;color:rgb(51,51,51);font-family:monospace;font-size:12px">Error log from ironic_pxe_tftp:</p><p style="margin:0px 0px 1.2em;padding:0px;width:auto;max-width:45em;color:rgb(51,51,51);font-family:monospace;font-size:12px">[root@undercloud ~]# podman logs 23427d845098<br>/bin/bash: /usr/sbin/in.tftpd: No such file or directory<br>/bin/bash: /usr/sbin/in.tftpd: No such file or directory<br>/bin/bash: /usr/sbin/in.tftpd: No such file or directory<br>/bin/bash: /usr/sbin/in.tftpd: No such file or directory<br>/bin/bash: /usr/sbin/in.tftpd: No such file or directory<br>/bin/bash: /usr/sbin/in.tftpd: No such file or directory<br>/bin/bash: /usr/sbin/in.tftpd: No such file or directory<br>/bin/bash: /usr/sbin/in.tftpd: No such file or directory<br>/bin/bash: /usr/sbin/in.tftpd: No such file or directory<br>/bin/bash: /usr/sbin/in.tftpd: No such file or directory<br>/bin/bash: /usr/sbin/in.tftpd: No such file or directory<br>/bin/bash: /usr/sbin/in.tftpd: No such file or directory<br>/bin/bash: /usr/sbin/in.tftpd: No such file or directory<br>/bin/bash: /usr/sbin/in.tftpd: No such file or directory<br>/bin/bash: /usr/sbin/in.tftpd: No such file or directory<br>/bin/bash: /usr/sbin/in.tftpd: No such file or directory<br>/bin/bash: /usr/sbin/in.tftpd: No such file or directory<br>/bin/bash: /usr/sbin/in.tftpd: No such file or directory<br>/bin/bash: /usr/sbin/in.tftpd: No such file or directory<br>/bin/bash: /usr/sbin/in.tftpd: No such file or directory<br>/bin/bash: /usr/sbin/in.tftpd: No such file or directory<br>/bin/bash: /usr/sbin/in.tftpd: No such file or directory</p><p style="margin:0px 0px 1.2em;padding:0px;width:auto;max-width:45em;color:rgb(51,51,51);font-family:monospace;font-size:12px">My undercloud config:</p><p style="margin:0px 0px 1.2em;padding:0px;width:auto;max-width:45em;color:rgb(51,51,51);font-family:monospace;font-size:12px">[DEFAULT]<br>undercloud_hostname = <a href="http://undercloud.taashee.com" target="_blank">undercloud.taashee.com</a><br>container_images_file = containers-prepare-parameter.yaml<br>local_ip = <a href="http://192.168.30.50/24" target="_blank">192.168.30.50/24</a><br>undercloud_public_host = 192.168.30.39<br>undercloud_admin_host = 192.168.30.41<br>undercloud_nameservers = 8.8.8.8<br>pxe_enabled = true<br>#undercloud_ntp_servers =<br>overcloud_domain_name = <a href="http://taashee.com" target="_blank">taashee.com</a><br>subnets = ctlplane-subnet<br>local_subnet = ctlplane-subnet<br>#undercloud_service_certificate =<br>generate_service_certificate = true<br>certificate_generation_ca = local<br>local_interface = eno3<br>inspection_extras = false<br>undercloud_debug = false<br>enable_tempest = false<br>enable_ui = false</p><p style="margin:0px 0px 1.2em;padding:0px;width:auto;max-width:45em;color:rgb(51,51,51);font-family:monospace;font-size:12px">[auth]</p><p style="margin:0px 0px 1.2em;padding:0px;width:auto;max-width:45em;color:rgb(51,51,51);font-family:monospace;font-size:12px">[ctlplane-subnet]<br>cidr = <a href="http://192.168.30.0/24" target="_blank">192.168.30.0/24</a><br>dhcp_start = 192.168.30.60<br>dhcp_end = 192.168.30.100<br>inspection_iprange = 192.168.30.110,192.168.30.150<br>gateway = 192.168.30.1</p><p style="margin:0px 0px 1.2em;padding:0px;width:auto;max-width:45em;color:rgb(51,51,51);font-family:monospace;font-size:12px">With regards,</p><p style="margin:0px 0px 1.2em;padding:0px;width:auto;max-width:45em;color:rgb(51,51,51);font-family:monospace;font-size:12px">Swogat Pradhan</p></div>
</blockquote></div>
</blockquote></div>
</blockquote></div>
</blockquote></div>
</blockquote></div>
</blockquote></div>
</blockquote></div>