<div dir="ltr">Hi Shephard,<div>Thanks, after changing the details as mentioned, Undercloud got installed successfully.</div><div>Now as a part to test the introspection we added a single node and initiated the introspection on which we are getting errors.</div><div>IP as per the inspector range is getting allocated, but soon after the IP allocation the introspection ILO gives the below error:</div><div><img src="cid:ii_l4gmxa2d0" alt="image.png" width="472" height="388"><br></div><div>it says, Downloading NBP file....</div><div><span style="color:rgb(90,90,90);font-family:"IBM Plex Sans","IBM Plex Mono";font-size:14px;letter-spacing:0.16px;background-color:rgb(229,229,229)">PXE-E99: Unexpected network error.</span><br></div><div><span style="color:rgb(90,90,90);font-family:"IBM Plex Sans","IBM Plex Mono";font-size:14px;letter-spacing:0.16px;background-color:rgb(229,229,229)"><br></span></div><div><span style="color:rgb(90,90,90);font-family:"IBM Plex Sans","IBM Plex Mono";font-size:14px;letter-spacing:0.16px;background-color:rgb(229,229,229)">Underlcoud.conf:</span></div><div><blockquote style="margin:0 0 0 40px;border:none;padding:0px"><div>undercloud_debug = true</div><div>clean_nodes = true</div><div>cleanup = false</div><div>container_cli = podman</div><div>container_healthcheck_disabled = true</div><div>container_images_file = /home/stack/containers-prepare-parameter.yaml</div><div>deployment_user = stack</div><div>enable_heat = true</div><div>enable_ironic = true</div><div>enable_ironic_inspector = true</div><div>enable_neutron = true</div><div>generate_service_certificate = false</div><div>enable_routed_networks = false</div><div>ipv6_address_mode = dhcpv6-stateful</div><div>ipxe_enabled = true</div><div>ironic_default_network_interface = neutron</div><div>ironic_enabled_network_interfaces = neutron,flat</div><div>local_interface = enp8s0</div><div>local_ip = aaaa:aaaa:aaaa::1/64</div><div>subnets = ctlplane-subnet</div><div>undercloud_admin_host = aaaa:aaaa:aaaa::1</div><div>undercloud_public_host = aaaa:aaaa:aaaa::1</div><div>undercloud_hostname = <a href="http://undercloud.com">undercloud.com</a></div><div>undercloud_ntp_servers = 30.30.30.3</div><div>undercloud_timezone = UTC</div><div>[ctlplane-subnet]</div><div>cidr = aaaa:aaaa:aaaa::/64</div><div>dhcp_end = aaaa:aaaa:aaaa::19</div><div>dhcp_start = aaaa:aaaa:aaaa::5</div><div>gateway = aaaa:aaaa:aaaa::1</div><div>inspection_iprange = aaaa:aaaa:aaaa::20,aaaa:aaaa:aaaa::40</div></blockquote></div><div><br></div><div>the ironic config in the container:</div><div><br></div><div>[root@undercloud /]# vi /etc/ironic-inspector/dnsmasq.conf<br>port=0<br>interface=br-ctlplane<br><br>dhcp-range=set:ctlplane-subnet,aaaa:aaaa:aaaa::20,aaaa:aaaa:aaaa::40,64,10m<br>dhcp-option-force=tag:ctlplane-subnet,option:mtu,1500<br>dhcp-sequential-ip<br>dhcp-match=ipxe,175<br>dhcp-match=set:efi,option:client-arch,7<br>dhcp-match=set:efi,option:client-arch,9<br>dhcp-match=set:efi,option:client-arch,11<br># dhcpv6s for Client System Architecture Type (61)<br>dhcp-match=set:efi6,option6:61,0007<br>dhcp-match=set:efi6,option6:61,0009<br>dhcp-match=set:efi6,option6:61,0011<br>dhcp-userclass=set:ipxe6,iPXE<br># Client is already running iPXE; move to next stage of chainloading<br>dhcp-boot=tag:ipxe,http://[aaaa:aaaa:aaaa::1]:8088/inspector.ipxe<br>dhcp-option=tag:ipxe6,option6:bootfile-url,http://[aaaa:aaaa:aaaa::1]:8088/inspector.ipxe<br># Client is PXE booting over EFI without iPXE ROM; send EFI version of iPXE chainloader<br>dhcp-boot=tag:efi,tag:!ipxe,snponly.efi<br>dhcp-option=tag:efi6,tag:!ipxe6,option6:bootfile-url,tftp://[aaaa:aaaa:aaaa::1]/snponly.efi<br># Client is running PXE over BIOS; send BIOS version of iPXE chainloader<br>dhcp-boot=undionly.kpxe,localhost.localdomain,aaaa:aaaa:aaaa::1<br><br>dhcp-hostsdir=/var/lib/ironic-inspector/dhcp-hostsdir<br><br></div><div><br></div><div>Please check and help me with the possible error and resolution. </div><div><br></div><div>Best Regards,</div><div>Lokendra</div><div><br></div><div><br></div><div><span style="color:rgb(90,90,90);font-family:"IBM Plex Sans","IBM Plex Mono";font-size:14px;letter-spacing:0.16px;background-color:rgb(229,229,229)"><br></span></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Thu, Jun 16, 2022 at 5:15 AM Brendan Shephard <<a href="mailto:bshephar@redhat.com">bshephar@redhat.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">Hey,<br><br>Looks like that is the problem. The [ ] around the IP address are causing the issue. If I try to run dnsmasq using exactly the output you get, it gives me the same error:<br><font face="monospace">[root@tripleo-director ~]# /usr/sbin/dnsmasq --keep-in-foreground --log-facility=/var/log/ironic/dnsmasq.log --user=root --conf-file=/dev/null --listen-address=[aaaa:aaaa:aaaa::1] --port=0 --enable-tftp --tftp-root=/var/lib/ironic/tftpboot</font><br><br>dnsmasq: bad command line options: try --help<br><br>VS without the [ ] I can see it starts up normally. <br><br>The settings in your undercloud.conf file look to be correct I believe. So I think there might be a bug here. I don't think we should be saving that value with the square brackets, or we would need to filter them out when we gather the value in that variable.<br><br>I raised a bug for it here so that we can dig into this and find what needs fixing:<br><a href="https://bugs.launchpad.net/tripleo/+bug/1978892" target="_blank">https://bugs.launchpad.net/tripleo/+bug/1978892</a><br><br>In the meantime, if you edit that hieradata value, are you able to get that container started?<br><br>Change this:<br><font face="monospace">[root@tripleo-director ~]# egrep -r 'tftp_bind_host' /etc/puppet/hieradata/<br>/etc/puppet/hieradata/service_configs.json:    "ironic::pxe::tftp_bind_host": "%{lookup('ctlplane_uri')}",</font><br><br>To this:<br> "ironic::pxe::tftp_bind_host": "aaaa:aaaa:aaaa::1"<br><br>Then restart the service:<br><font face="monospace">sudo systemctl restart tripleo_ironic_pxe_http.service tripleo_ironic_pxe_tftp.service</font><br><br>Does that get the container running without the error? I did the same in my environment and can see that dnsmasq is running properly like that:<br><font face="monospace">[root@tripleo-director ~]# ps -ef | grep aaaa<br>root       71180   52675  0 19:24 pts/4    00:00:00 /usr/sbin/dnsmasq --keep-in-foreground --log-facility=/var/log/ironic/dnsmasq.log --user=root --conf-file=/dev/null --listen-address=aaaa:aaaa:aaaa::1 --port=0 --enable-tftp --tftp-root=/var/lib/ironic/tftpboot</font><br><br clear="all"><div><div dir="ltr"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div>
        <p style="font-weight:bold;margin:0px;padding:0px;font-size:14px;text-transform:capitalize;font-family:RedHatText,sans-serif">
          <span>Brendan</span> <span>Shephard</span><span style="color:rgb(170,170,170);margin:0px"></span>
        </p>
        
        <p style="font-weight:normal;font-size:12px;margin:0px;text-transform:capitalize;font-family:RedHatText,sans-serif">
          <span>Software Engineer</span>
        </p>
        <p style="font-weight:normal;margin:0px 0px 4px;font-size:12px;font-family:RedHatText,sans-serif">
          <a style="color:rgb(0,136,206);font-size:12px;margin:0px;text-decoration:none;font-family:RedHatText,sans-serif" href="https://www.redhat.com" target="_blank">Red Hat <span>APAC</span></a>
        </p>
    <div style="margin-bottom:4px">
      <span>
        <p style="font-size:12px;margin:0px;font-family:RedHatText,sans-serif">193 N Quay</p>
      </span>
      <span>
        <p style="font-size:12px;margin:0px;font-family:RedHatText,sans-serif">Brisbane City QLD 4000</p>
      </span>
    </div>
    
    
    <div style="font-weight:normal;font-size:12px;font-family:RedHatText,sans-serif;margin-bottom:8px">
      <div>
        <a href="https://twitter.com/redhat" title="twitter" style="background:url("https://marketing-outfit-prod-images.s3-us-west-2.amazonaws.com/3780bd4ede961ef3cd4108b8c0e80186/web-icon-twitter.png") 0px 50%/13px no-repeat scroll transparent;text-decoration:none;color:rgb(0,0,0);display:inline-block;line-height:20px;padding-left:13px" target="_blank">
          <span style="margin-left:2px">@RedHat</span>
        </a>  
        <a href="https://www.linkedin.com/company/red-hat" title="LinkedIn" style="background:url("https://marketing-outfit-prod-images.s3-us-west-2.amazonaws.com/8d3507e3c6b6c9ad10e301accf1a4af0/web-icon-linkedin.png") 0px 50%/12px no-repeat scroll transparent;text-decoration:none;color:rgb(0,0,0);display:inline-block;line-height:20px;padding-left:12px;margin:0px 4px 0px 3px;padding-top:1px" target="_blank">
          <span style="margin-left:4px">Red Hat</span>
        </a> 
        <a href="https://www.facebook.com/RedHatInc" title="Facebook" style="background:url("https://marketing-outfit-prod-images.s3-us-west-2.amazonaws.com/220b85e2f100025e94cb1bcd993bd51d/web-icon-facebook.png") 0px 50%/11px no-repeat scroll transparent;text-decoration:none;color:rgb(0,0,0);display:inline-block;line-height:20px;padding-left:13px" target="_blank">
          <span>Red Hat</span>
        </a>
      </div>
      
    </div>

    <div style="margin-top:12px">
      <table border="0">
        <tbody><tr>
          <td width="100px"><a href="https://red.ht/sig" target="_blank"> <img src="https://static.redhat.com/libs/redhat/brand-assets/latest/corp/logo.png" width="90" height="auto"></a> </td>
          <td style="font-weight:normal;font-size:12px">
            <div><a href="https://redhat.com/summit" style="text-decoration:none" target="_blank"><img style="outline: currentcolor none 0px;" src="https://static.redhat.com/libs/redhat/brand-assets/latest/events/red-hat-summit.png" width="53px" height="auto"></a></div>
          </td>
        </tr>
      </tbody></table>
    </div>

  </div><span></span></div></div></div></div></div></div></div></div></div></div></div><br></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Thu, Jun 16, 2022 at 12:12 AM Lokendra Rathour <<a href="mailto:lokendrarathour@gmail.com" target="_blank">lokendrarathour@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">Hi Shephard,<div>I am getting the local_ip (ipv6) of the undercloud :</div><div><br>[root@undercloud stack]# sudo hiera ironic::pxe::tftp_bind_host -c /etc/puppet/hiera.yaml<br>[aaaa:aaaa:aaaa::1]<br></div><div><br></div><div>is this because of some ipv6 reasons?</div><div><br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Jun 15, 2022 at 6:08 PM Brendan Shephard <<a href="mailto:bshephar@redhat.com" target="_blank">bshephar@redhat.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">Hey,<div><br></div><div>Ok, that command looks fine. What about that variable there? Do you get anything back when you run:</div><div><font face="monospace">sudo hiera ironic::pxe::tftp_bind_host -c /etc/puppet/hiera.yaml</font></div><div><br></div><div>Mine returns:</div><div><font face="monospace">sudo hiera ironic::pxe::tftp_bind_host -c /etc/puppet/hiera.yaml<br>192.168.24.115</font><br></div><div><br clear="all"><div><div dir="ltr"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div>
        <p style="font-weight:bold;margin:0px;padding:0px;font-size:14px;text-transform:capitalize;font-family:RedHatText,sans-serif">
          <span>Brendan</span> <span>Shephard</span><span style="color:rgb(170,170,170);margin:0px"></span>
        </p>
        
        <p style="font-weight:normal;font-size:12px;margin:0px;text-transform:capitalize;font-family:RedHatText,sans-serif">
          <span>Software Engineer</span>
        </p>
        <p style="font-weight:normal;margin:0px 0px 4px;font-size:12px;font-family:RedHatText,sans-serif">
          <a style="color:rgb(0,136,206);font-size:12px;margin:0px;text-decoration:none;font-family:RedHatText,sans-serif" href="https://www.redhat.com" target="_blank">Red Hat <span>APAC</span></a>
        </p>
    <div style="margin-bottom:4px">
      <span>
        <p style="font-size:12px;margin:0px;font-family:RedHatText,sans-serif">193 N Quay</p>
      </span>
      <span>
        <p style="font-size:12px;margin:0px;font-family:RedHatText,sans-serif">Brisbane City QLD 4000</p>
      </span>
    </div>
    
    
    <div style="font-weight:normal;font-size:12px;font-family:RedHatText,sans-serif;margin-bottom:8px">
      <div>
        <a href="https://twitter.com/redhat" title="twitter" style="background:url("https://marketing-outfit-prod-images.s3-us-west-2.amazonaws.com/3780bd4ede961ef3cd4108b8c0e80186/web-icon-twitter.png") 0px 50%/13px no-repeat scroll transparent;text-decoration:none;color:rgb(0,0,0);display:inline-block;line-height:20px;padding-left:13px" target="_blank">
          <span style="margin-left:2px">@RedHat</span>
        </a>  
        <a href="https://www.linkedin.com/company/red-hat" title="LinkedIn" style="background:url("https://marketing-outfit-prod-images.s3-us-west-2.amazonaws.com/8d3507e3c6b6c9ad10e301accf1a4af0/web-icon-linkedin.png") 0px 50%/12px no-repeat scroll transparent;text-decoration:none;color:rgb(0,0,0);display:inline-block;line-height:20px;padding-left:12px;margin:0px 4px 0px 3px;padding-top:1px" target="_blank">
          <span style="margin-left:4px">Red Hat</span>
        </a> 
        <a href="https://www.facebook.com/RedHatInc" title="Facebook" style="background:url("https://marketing-outfit-prod-images.s3-us-west-2.amazonaws.com/220b85e2f100025e94cb1bcd993bd51d/web-icon-facebook.png") 0px 50%/11px no-repeat scroll transparent;text-decoration:none;color:rgb(0,0,0);display:inline-block;line-height:20px;padding-left:13px" target="_blank">
          <span>Red Hat</span>
        </a>
      </div>
      
    </div>

    <div style="margin-top:12px">
      <table border="0">
        <tbody><tr>
          <td width="100px"><a href="https://red.ht/sig" target="_blank"> <img src="https://static.redhat.com/libs/redhat/brand-assets/latest/corp/logo.png" width="90" height="auto"></a> </td>
          <td style="font-weight:normal;font-size:12px">
            <div><a href="https://redhat.com/summit" style="text-decoration:none" target="_blank"><img style="outline: currentcolor none 0px;" src="https://static.redhat.com/libs/redhat/brand-assets/latest/events/red-hat-summit.png" width="53px" height="auto"></a></div>
          </td>
        </tr>
      </tbody></table>
    </div>

  </div><span></span></div></div></div></div></div></div></div></div></div></div></div><br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Jun 15, 2022 at 8:20 PM Lokendra Rathour <<a href="mailto:lokendrarathour@gmail.com" target="_blank">lokendrarathour@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">Hi Shephard,<div><br></div><div>this is the command from my wallaby:</div><div>[root@undercloud ~]# sudo cat /var/lib/tripleo-config/container-startup-config/step_4/ironic_pxe_tftp.json<br>{<br>  "cap_add": [<br>    "NET_ADMIN",<br>    "NET_RAW",<br>    "SETUID"<br>  ],<br>  "command": [<br>    "/bin/bash",<br>    "-c",<br><span style="background-color:rgb(255,255,0)">    "BIND_HOST=$(hiera ironic::pxe::tftp_bind_host -c /etc/puppet/hiera.yaml); /usr/sbin/dnsmasq --keep-in-foreground --log-facility=/var/log/ironic/dnsmasq.log --user=root --conf-file=/dev/null --listen-address=$BIND_HOST --port=0 --enable-tftp --tftp-root=/var/lib/ironic/tftpboot"</span><br>  ],<br>  "environment": {<br>    "KOLLA_CONFIG_STRATEGY": "COPY_ALWAYS",<br>    "TRIPLEO_CONFIG_HASH": "9fb3e4e0e35ee35fdf74cfccb16a7543"<br>  },<br>  "healthcheck": {<br>    "test": "/openstack/healthcheck"<br>  },<br>  "image": "undercloud.ctlplane.localdomain:8787/tripleowallaby/openstack-ironic-pxe:current-tripleo",<br>  "net": "host",<br>  "privileged": false,<br>  "restart": "always",<br>  "start_order": 90,<br>  "volumes": [<br>    "/etc/hosts:/etc/hosts:ro",<br>    "/etc/localtime:/etc/localtime:ro",<br>    "/etc/pki/ca-trust/extracted:/etc/pki/ca-trust/extracted:ro",<br>    "/etc/pki/ca-trust/source/anchors:/etc/pki/ca-trust/source/anchors:ro",<br>    "/etc/pki/tls/certs/ca-bundle.crt:/etc/pki/tls/certs/ca-bundle.crt:ro",<br>    "/etc/pki/tls/certs/ca-bundle.trust.crt:/etc/pki/tls/certs/ca-bundle.trust.crt:ro",<br>    "/etc/pki/tls/cert.pem:/etc/pki/tls/cert.pem:ro",<br>    "/dev/log:/dev/log",<br>    "/etc/puppet:/etc/puppet:ro",<br>    "/var/lib/kolla/config_files/ironic_pxe_tftp.json:/var/lib/kolla/config_files/config.json:ro",<br>    "/var/lib/config-data/puppet-generated/ironic:/var/lib/kolla/config_files/src:ro",<br>    "/var/lib/ironic:/var/lib/ironic:shared,z",<br>    "/var/log/containers/ironic:/var/log/ironic:z",<br>    "/var/log/containers/httpd/ironic-pxe:/var/log/httpd:z"<br>  ]<br>}[root@undercloud ~]#<br></div><div><br></div><div>Comparing both, they look alike.</div><div>please check once.</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Jun 15, 2022 at 3:30 PM Brendan Shephard <<a href="mailto:bshephar@redhat.com" target="_blank">bshephar@redhat.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">Hi,<div><br></div><div>Looks like the command was in a different file in Wallaby, can you check:</div><div><font face="monospace">sudo cat /var/lib/tripleo-config/container-startup-config/step_4/ironic_pxe_tftp.json</font></div><div><br></div><div>That one should have the dnsmasq command it's trying to run. For example, here it is from my Wallaby environment:</div><div><font face="monospace">[stack@undercloud-0 ~]$ sudo cat /var/lib/tripleo-config/container-startup-config/step_4/ironic_pxe_tftp.json | jq .command<br>[<br>  "/bin/bash",<br>  "-c",<br>  "BIND_HOST=$(hiera ironic::pxe::tftp_bind_host -c /etc/puppet/hiera.yaml); /usr/sbin/dnsmasq --keep-in-foreground --log-facility=/var/log/ironic/dnsmasq.log --user=root --conf-file=/dev/null --listen-address=$BIND_HOST --port=0 --enable-tftp --tftp-root=/var/lib/ironic/tftpboot"<br>]</font><br></div><div><br></div><div><br></div><div><br clear="all"><div><div dir="ltr"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div>
        <p style="font-weight:bold;margin:0px;padding:0px;font-size:14px;text-transform:capitalize;font-family:RedHatText,sans-serif">
          <span>Brendan</span> <span>Shephard</span><span style="color:rgb(170,170,170);margin:0px"></span>
        </p>
        
        <p style="font-weight:normal;font-size:12px;margin:0px;text-transform:capitalize;font-family:RedHatText,sans-serif">
          <span>Software Engineer</span>
        </p>
        <p style="font-weight:normal;margin:0px 0px 4px;font-size:12px;font-family:RedHatText,sans-serif">
          <a style="color:rgb(0,136,206);font-size:12px;margin:0px;text-decoration:none;font-family:RedHatText,sans-serif" href="https://www.redhat.com" target="_blank">Red Hat <span>APAC</span></a>
        </p>
    <div style="margin-bottom:4px">
      <span>
        <p style="font-size:12px;margin:0px;font-family:RedHatText,sans-serif">193 N Quay</p>
      </span>
      <span>
        <p style="font-size:12px;margin:0px;font-family:RedHatText,sans-serif">Brisbane City QLD 4000</p>
      </span>
    </div>
    
    
    <div style="font-weight:normal;font-size:12px;font-family:RedHatText,sans-serif;margin-bottom:8px">
      <div>
        <a href="https://twitter.com/redhat" title="twitter" style="background-image:url("https://marketing-outfit-prod-images.s3-us-west-2.amazonaws.com/3780bd4ede961ef3cd4108b8c0e80186/web-icon-twitter.png");background-size:13px;background-color:transparent;text-decoration:none;color:rgb(0,0,0);display:inline-block;line-height:20px;padding-left:13px;background-position:0px 50%" target="_blank">
          <span style="margin-left:2px">@RedHat</span>
        </a>  
        <a href="https://www.linkedin.com/company/red-hat" title="LinkedIn" style="background-image:url("https://marketing-outfit-prod-images.s3-us-west-2.amazonaws.com/8d3507e3c6b6c9ad10e301accf1a4af0/web-icon-linkedin.png");background-size:12px;background-color:transparent;text-decoration:none;color:rgb(0,0,0);display:inline-block;line-height:20px;padding-left:12px;margin:0px 4px 0px 3px;padding-top:1px;background-position:0px 50%" target="_blank">
          <span style="margin-left:4px">Red Hat</span>
        </a> 
        <a href="https://www.facebook.com/RedHatInc" title="Facebook" style="background-image:url("https://marketing-outfit-prod-images.s3-us-west-2.amazonaws.com/220b85e2f100025e94cb1bcd993bd51d/web-icon-facebook.png");background-size:11px;background-color:transparent;text-decoration:none;color:rgb(0,0,0);display:inline-block;line-height:20px;padding-left:13px;background-position:0px 50%" target="_blank">
          <span>Red Hat</span>
        </a>
      </div>
      
    </div>

    <div style="margin-top:12px">
      <table border="0">
        <tbody><tr>
          <td width="100px"><a href="https://red.ht/sig" target="_blank"> <img src="https://static.redhat.com/libs/redhat/brand-assets/latest/corp/logo.png" width="90" height="auto"></a> </td>
          <td style="font-weight:normal;font-size:12px">
            <div><a href="https://redhat.com/summit" style="text-decoration:none" target="_blank"><img style="outline: currentcolor none 0px;" src="https://static.redhat.com/libs/redhat/brand-assets/latest/events/red-hat-summit.png" width="53px" height="auto"></a></div>
          </td>
        </tr>
      </tbody></table>
    </div>

  </div><span></span></div></div></div></div></div></div></div></div></div></div></div><br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Jun 15, 2022 at 7:19 PM Lokendra Rathour <<a href="mailto:lokendrarathour@gmail.com" target="_blank">lokendrarathour@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">Hi Shephard,<div>Here is the o/p of the file:</div><div><br></div><div>[root@undercloud ~]# sudo cat /var/lib/kolla/config_files/ironic_pxe_tftp.json<br>{<br>  "config_files": [<br>    {<br>      "dest": "/",<br>      "merge": true,<br>      "preserve_properties": true,<br>      "source": "/var/lib/kolla/config_files/src/*"<br>    }<br>  ],<br>  "permissions": [<br>    {<br>      "owner": "ironic:ironic",<br>      "path": "/var/log/ironic",<br>      "recurse": true<br>    },<br>    {<br>      "owner": "ironic:ironic",<br>      "path": "/var/lib/ironic",<br>      "recurse": true<br>    }<br>  ]<br>}[root@undercloud ~]#<br></div><div><br></div><div><br></div><div>Thanks once agan. </div><div><br></div><div>-Lokendra</div><div><br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Jun 15, 2022 at 2:38 PM Brendan Shephard <<a href="mailto:bshephar@redhat.com" target="_blank">bshephar@redhat.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">Looks like something wrong with the dnsmasq command the container is being launched with. What command is it trying to run?<br><br><font face="monospace">sudo cat /var/lib/kolla/config_files/ironic_pxe_tftp.json</font><br><br clear="all"><div><div dir="ltr"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div>
        <p style="font-weight:bold;margin:0px;padding:0px;font-size:14px;text-transform:capitalize;font-family:RedHatText,sans-serif">
          <span>Brendan</span> <span>Shephard</span><span style="color:rgb(170,170,170);margin:0px"></span>
        </p>
        
        <p style="font-weight:normal;font-size:12px;margin:0px;text-transform:capitalize;font-family:RedHatText,sans-serif">
          <span>Software Engineer</span>
        </p>
        <p style="font-weight:normal;margin:0px 0px 4px;font-size:12px;font-family:RedHatText,sans-serif">
          <a style="color:rgb(0,136,206);font-size:12px;margin:0px;text-decoration:none;font-family:RedHatText,sans-serif" href="https://www.redhat.com" target="_blank">Red Hat <span>APAC</span></a>
        </p>
    <div style="margin-bottom:4px">
      <span>
        <p style="font-size:12px;margin:0px;font-family:RedHatText,sans-serif">193 N Quay</p>
      </span>
      <span>
        <p style="font-size:12px;margin:0px;font-family:RedHatText,sans-serif">Brisbane City QLD 4000</p>
      </span>
    </div>
    
    
    <div style="font-weight:normal;font-size:12px;font-family:RedHatText,sans-serif;margin-bottom:8px">
      <div>
        <a href="https://twitter.com/redhat" title="twitter" style="background-image:url("https://marketing-outfit-prod-images.s3-us-west-2.amazonaws.com/3780bd4ede961ef3cd4108b8c0e80186/web-icon-twitter.png");background-size:13px;background-color:transparent;text-decoration:none;color:rgb(0,0,0);display:inline-block;line-height:20px;padding-left:13px;background-position:0px 50%" target="_blank">
          <span style="margin-left:2px">@RedHat</span>
        </a>  
        <a href="https://www.linkedin.com/company/red-hat" title="LinkedIn" style="background-image:url("https://marketing-outfit-prod-images.s3-us-west-2.amazonaws.com/8d3507e3c6b6c9ad10e301accf1a4af0/web-icon-linkedin.png");background-size:12px;background-color:transparent;text-decoration:none;color:rgb(0,0,0);display:inline-block;line-height:20px;padding-left:12px;margin:0px 4px 0px 3px;padding-top:1px;background-position:0px 50%" target="_blank">
          <span style="margin-left:4px">Red Hat</span>
        </a> 
        <a href="https://www.facebook.com/RedHatInc" title="Facebook" style="background-image:url("https://marketing-outfit-prod-images.s3-us-west-2.amazonaws.com/220b85e2f100025e94cb1bcd993bd51d/web-icon-facebook.png");background-size:11px;background-color:transparent;text-decoration:none;color:rgb(0,0,0);display:inline-block;line-height:20px;padding-left:13px;background-position:0px 50%" target="_blank">
          <span>Red Hat</span>
        </a>
      </div>
      
    </div>

    <div style="margin-top:12px">
      <table border="0">
        <tbody><tr>
          <td width="100px"><a href="https://red.ht/sig" target="_blank"> <img src="https://static.redhat.com/libs/redhat/brand-assets/latest/corp/logo.png" width="90" height="auto"></a> </td>
          <td style="font-weight:normal;font-size:12px">
            <div><a href="https://redhat.com/summit" style="text-decoration:none" target="_blank"><img style="outline: currentcolor none 0px;" src="https://static.redhat.com/libs/redhat/brand-assets/latest/events/red-hat-summit.png" width="53px" height="auto"></a></div>
          </td>
        </tr>
      </tbody></table>
    </div>

  </div><span></span></div></div></div></div></div></div></div></div></div></div></div><br></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Jun 15, 2022 at 6:22 PM Anirudh Gupta <<a href="mailto:anyrude10@gmail.com" target="_blank">anyrude10@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">Hi Brendan,<div><br></div><div>Thanks for your response.</div><div><br></div><div>Please find the log below.</div><div><br></div><div><p style="box-sizing:border-box;margin:0px;color:rgb(36,36,36);font-family:-apple-system,BlinkMacSystemFont,"Segoe UI","Apple Color Emoji","Segoe UI Emoji","Segoe UI Web",sans-serif;font-size:14px;font-style:inherit;font-weight:inherit"><span style="box-sizing:border-box;font-size:small;font-style:inherit;font-weight:inherit">[stack@undercloud t2u2v2w]$ sudo podman logs ironic_pxe_tftp<br style="box-sizing:border-box"><br style="box-sizing:border-box"><font size="1" style="box-sizing:border-box">dnsmasq: bad command line options: try --help<br style="box-sizing:border-box">dnsmasq: bad command line options: try --help<br style="box-sizing:border-box">dnsmasq: bad command line options: try --help<br style="box-sizing:border-box">dnsmasq: bad command line options: try --help<br style="box-sizing:border-box">dnsmasq: bad command line options: try --help<br style="box-sizing:border-box">dnsmasq: bad command line options: try --help</font></span><br style="box-sizing:border-box"><br style="box-sizing:border-box"></p><p style="box-sizing:border-box;margin:0px;color:rgb(36,36,36);font-family:-apple-system,BlinkMacSystemFont,"Segoe UI","Apple Color Emoji","Segoe UI Emoji","Segoe UI Web",sans-serif;font-size:14px;font-style:inherit;font-weight:inherit"><span style="box-sizing:border-box;font-size:small;font-style:inherit;font-weight:inherit">[stack@undercloud t2u2v2w]$  sudo podman ps --filter name=ironic_pxe -a<br style="box-sizing:border-box"><font size="1" style="box-sizing:border-box">CONTAINER ID  IMAGE                                                                                     COMMAND               CREATED      STATUS                              PORTS       NAMES<br style="box-sizing:border-box">02dacbc74cec  undercloud.ctlplane.localdomain:8787/tripleowallaby/openstack-ironic-pxe:current-tripleo  /bin/bash -c BIND...  3 hours ago  Exited (1) 3 hours ago (unhealthy)              ironic_pxe_tftp<br style="box-sizing:border-box">1f8ca39fba32  undercloud.ctlplane.localdomain:8787/tripleowallaby/openstack-ironic-pxe:current-tripleo  kolla_start           3 hours ago  Up 3 hours ago (healthy)                        ironic_pxe_http</font></span></p><p style="box-sizing:border-box;margin:0px;color:rgb(36,36,36);font-family:-apple-system,BlinkMacSystemFont,"Segoe UI","Apple Color Emoji","Segoe UI Emoji","Segoe UI Web",sans-serif;font-size:14px;font-style:inherit;font-weight:inherit"><span style="box-sizing:border-box;font-size:small;font-style:inherit;font-weight:inherit"><font size="1" style="box-sizing:border-box"><br></font></span></p><p style="box-sizing:border-box;margin:0px;color:rgb(36,36,36);font-family:-apple-system,BlinkMacSystemFont,"Segoe UI","Apple Color Emoji","Segoe UI Emoji","Segoe UI Web",sans-serif;font-size:14px;font-style:inherit;font-weight:inherit"><span style="box-sizing:border-box;font-size:small;font-style:inherit;font-weight:inherit"><font size="1" style="box-sizing:border-box">Regards</font></span></p><p style="box-sizing:border-box;margin:0px;color:rgb(36,36,36);font-family:-apple-system,BlinkMacSystemFont,"Segoe UI","Apple Color Emoji","Segoe UI Emoji","Segoe UI Web",sans-serif;font-size:14px;font-style:inherit;font-weight:inherit"><span style="box-sizing:border-box;font-size:small;font-style:inherit;font-weight:inherit"><font size="1" style="box-sizing:border-box">Anirudh Gupta</font></span></p></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Jun 15, 2022 at 11:30 AM Brendan Shephard <<a href="mailto:bshephar@redhat.com" target="_blank">bshephar@redhat.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">Hey Anirudh,<br><br>You would need to look at the logs for the <span style="color:rgb(36,36,36);font-family:-apple-system,BlinkMacSystemFont,"Segoe UI","Apple Color Emoji","Segoe UI Emoji","Segoe UI Web",sans-serif;font-size:14px">ironic_pxe_tftp </span><span style="color:rgb(36,36,36);font-family:-apple-system,BlinkMacSystemFont,"Segoe UI","Apple Color Emoji","Segoe UI Emoji","Segoe UI Web",sans-serif">container to see why it's failing.</span><div><font color="#242424" face="-apple-system, BlinkMacSystemFont, Segoe UI, Apple Color Emoji, Segoe UI Emoji, Segoe UI Web, sans-serif"><br>I assume the tftp container is not Up when you run this command?<br></font><font face="monospace">[stack@tripleo-director overcloud_playbooks]$ sudo podman ps --filter name=ironic_pxe -a<br>CONTAINER ID  IMAGE                                                                                       COMMAND      CREATED      STATUS                     PORTS       NAMES<br>0170be36e291  <a href="http://registry.okd4.bne-shift.net:8443/tripleomastercentos9/openstack-ironic-pxe:current-tripleo" target="_blank">registry.okd4.bne-shift.net:8443/tripleomastercentos9/openstack-ironic-pxe:current-tripleo</a>  kolla_start  12 days ago  Up 30 hours ago (healthy)              ironic_pxe_tftp<br>e507f722bdf0  <a href="http://registry.okd4.bne-shift.net:8443/tripleomastercentos9/openstack-ironic-pxe:current-tripleo" target="_blank">registry.okd4.bne-shift.net:8443/tripleomastercentos9/openstack-ironic-pxe:current-tripleo</a>  kolla_start  12 days ago  Up 30 hours ago (healthy)              ironic_pxe_http</font><br><font color="#242424" face="-apple-system, BlinkMacSystemFont, Segoe UI, Apple Color Emoji, Segoe UI Emoji, Segoe UI Web, sans-serif"><br>Then check the logs to see what the error is:<br></font><font face="monospace">[stack@tripleo-director overcloud_playbooks]$ sudo podman logs ironic_pxe_tftp</font><font color="#242424" face="-apple-system, BlinkMacSystemFont, Segoe UI, Apple Color Emoji, Segoe UI Emoji, Segoe UI Web, sans-serif"><br></font></div><div><font color="#242424" face="-apple-system, BlinkMacSystemFont, Segoe UI, Apple Color Emoji, Segoe UI Emoji, Segoe UI Web, sans-serif"><br><br><br clear="all"></font><div><div dir="ltr"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div>
        <p style="font-weight:bold;margin:0px;padding:0px;font-size:14px;text-transform:capitalize;font-family:RedHatText,sans-serif">
          <span>Brendan</span> <span>Shephard</span><span style="color:rgb(170,170,170);margin:0px"></span>
        </p>
        
        <p style="font-weight:normal;font-size:12px;margin:0px;text-transform:capitalize;font-family:RedHatText,sans-serif">
          <span>Software Engineer</span>
        </p>
        <p style="font-weight:normal;margin:0px 0px 4px;font-size:12px;font-family:RedHatText,sans-serif">
          <a style="color:rgb(0,136,206);font-size:12px;margin:0px;text-decoration:none;font-family:RedHatText,sans-serif" href="https://www.redhat.com" target="_blank">Red Hat <span>APAC</span></a>
        </p>
    <div style="margin-bottom:4px">
      <span>
        <p style="font-size:12px;margin:0px;font-family:RedHatText,sans-serif">193 N Quay</p>
      </span>
      <span>
        <p style="font-size:12px;margin:0px;font-family:RedHatText,sans-serif">Brisbane City QLD 4000</p>
      </span>
    </div>
    
    
    <div style="font-weight:normal;font-size:12px;font-family:RedHatText,sans-serif;margin-bottom:8px">
      <div>
        <a href="https://twitter.com/redhat" title="twitter" style="background-image:url("https://marketing-outfit-prod-images.s3-us-west-2.amazonaws.com/3780bd4ede961ef3cd4108b8c0e80186/web-icon-twitter.png");background-size:13px;background-color:transparent;text-decoration:none;color:rgb(0,0,0);display:inline-block;line-height:20px;padding-left:13px;background-position:0px 50%" target="_blank">
          <span style="margin-left:2px">@RedHat</span>
        </a>  
        <a href="https://www.linkedin.com/company/red-hat" title="LinkedIn" style="background-image:url("https://marketing-outfit-prod-images.s3-us-west-2.amazonaws.com/8d3507e3c6b6c9ad10e301accf1a4af0/web-icon-linkedin.png");background-size:12px;background-color:transparent;text-decoration:none;color:rgb(0,0,0);display:inline-block;line-height:20px;padding-left:12px;margin:0px 4px 0px 3px;padding-top:1px;background-position:0px 50%" target="_blank">
          <span style="margin-left:4px">Red Hat</span>
        </a> 
        <a href="https://www.facebook.com/RedHatInc" title="Facebook" style="background-image:url("https://marketing-outfit-prod-images.s3-us-west-2.amazonaws.com/220b85e2f100025e94cb1bcd993bd51d/web-icon-facebook.png");background-size:11px;background-color:transparent;text-decoration:none;color:rgb(0,0,0);display:inline-block;line-height:20px;padding-left:13px;background-position:0px 50%" target="_blank">
          <span>Red Hat</span>
        </a>
      </div>
      
    </div>

    <div style="margin-top:12px">
      <table border="0">
        <tbody><tr>
          <td width="100px"><a href="https://red.ht/sig" target="_blank"> <img src="https://static.redhat.com/libs/redhat/brand-assets/latest/corp/logo.png" width="90" height="auto"></a> </td>
          <td style="font-weight:normal;font-size:12px">
            <div><a href="https://redhat.com/summit" style="text-decoration:none" target="_blank"><img style="outline: currentcolor none 0px;" src="https://static.redhat.com/libs/redhat/brand-assets/latest/events/red-hat-summit.png" width="53px" height="auto"></a></div>
          </td>
        </tr>
      </tbody></table>
    </div>

  </div><span></span></div></div></div></div></div></div></div></div></div></div></div><br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Jun 15, 2022 at 7:53 AM Anirudh Gupta <<a href="mailto:anyrude10@gmail.com" target="_blank">anyrude10@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">Hi Team,<div><br></div><div>I am trying to deploy Openstack Wallaby Undercloud on IPv6, but facing the below error:</div><div><br></div><div><span style="color:rgb(36,36,36);font-family:-apple-system,BlinkMacSystemFont,"Segoe UI","Apple Color Emoji","Segoe UI Emoji","Segoe UI Web",sans-serif;font-size:14px">2022-06-14 05:01:23.213708 | 52540083-cfa2-3f20-e9dc-00000000286f | TASK | Manage container systemd services and cleanup old systemd healthchecks for /var/lib/tripleo-config/container-startup-config/step_4</span><br style="box-sizing:border-box;color:rgb(36,36,36);font-family:-apple-system,BlinkMacSystemFont,"Segoe UI","Apple Color Emoji","Segoe UI Emoji","Segoe UI Web",sans-serif;font-size:14px"><span style="color:rgb(36,36,36);font-family:-apple-system,BlinkMacSystemFont,"Segoe UI","Apple Color Emoji","Segoe UI Emoji","Segoe UI Web",sans-serif;font-size:14px">2022-06-14 05:03:22.912816 | 52540083-cfa2-3f20-e9dc-00000000286f | FATAL | Manage container systemd services and cleanup old systemd healthchecks for /var/lib/tripleo-config/container-startup-config/step_4 | undercloud | error={"changed": false, "msg": "Service ironic_pxe_tftp has not started yet"}</span><br style="box-sizing:border-box;color:rgb(36,36,36);font-family:-apple-system,BlinkMacSystemFont,"Segoe UI","Apple Color Emoji","Segoe UI Emoji","Segoe UI Web",sans-serif;font-size:14px"><span style="color:rgb(36,36,36);font-family:-apple-system,BlinkMacSystemFont,"Segoe UI","Apple Color Emoji","Segoe UI Emoji","Segoe UI Web",sans-serif;font-size:14px">2022-06-14 05:03:22.914400 | 52540083-cfa2-3f20-e9dc-00000000286f | TIMING | tripleo_container_manage : Manage container systemd</span><br></div><div><span style="color:rgb(36,36,36);font-family:-apple-system,BlinkMacSystemFont,"Segoe UI","Apple Color Emoji","Segoe UI Emoji","Segoe UI Web",sans-serif;font-size:14px"><br></span></div><div><span style="color:rgb(36,36,36);font-family:-apple-system,BlinkMacSystemFont,"Segoe UI","Apple Color Emoji","Segoe UI Emoji","Segoe UI Web",sans-serif;font-size:14px">Sample Undercloud.conf is as follows:</span></div><div><span style="color:rgb(36,36,36);font-family:-apple-system,BlinkMacSystemFont,"Segoe UI","Apple Color Emoji","Segoe UI Emoji","Segoe UI Web",sans-serif;font-size:14px"><br></span></div><div>[DEFAULT]<br>clean_nodes = true<br>cleanup = false<br>container_cli = podman<br>container_healthcheck_disabled = true<br>container_images_file = /home/stack/containers-prepare-parameter.yaml<br>deployment_user = stack<br>enable_ironic = true<br>enable_ironic_inspector = true<br>enable_neutron = true<br>enable_routed_networks = false<br>generate_service_certificate = false<br>ipv6_address_mode = dhcpv6-stateful<br>ipxe_enabled = true<br>local_interface = enp8s0<br>local_ip = aaaa:aaaa:aaaa::1/64<br>subnets = ctlplane-subnet<br>undercloud_admin_host = aaaa:aaaa:aaaa::1<br>undercloud_hostname = <a href="http://undercloud.com" target="_blank">undercloud.com</a><br>undercloud_ntp_servers = 30.30.30.3<br>undercloud_public_host = aaaa:aaaa:aaaa::1<br>undercloud_timezone = UTC<br><br>[ctlplane-subnet]<br>cidr = aaaa:aaaa:aaaa::/64<br>dhcp_end = aaaa:aaaa:aaaa::f<br>dhcp_start = aaaa:aaaa:aaaa::a<br>gateway = aaaa:aaaa:aaaa::1<br>inspection_iprange = aaaa:aaaa:aaaa::3,aaaa:aaaa:aaaa::9<span style="color:rgb(36,36,36);font-family:-apple-system,BlinkMacSystemFont,"Segoe UI","Apple Color Emoji","Segoe UI Emoji","Segoe UI Web",sans-serif;font-size:14px"><br></span></div><div><br></div><div>Can someone please help in this regard.</div><div><br></div><div>Anirudh Gupta</div><div><span style="color:rgb(36,36,36);font-family:-apple-system,BlinkMacSystemFont,"Segoe UI","Apple Color Emoji","Segoe UI Emoji","Segoe UI Web",sans-serif;font-size:14px"><br></span></div></div>
</blockquote></div>
</blockquote></div>
</blockquote></div>
</blockquote></div><br clear="all"><div><br></div>-- <br><div dir="ltr"><div dir="ltr"><div><div dir="ltr"><div dir="ltr">~ Lokendra</div><div dir="ltr"><a href="http://www.inertiaspeaks.com" target="_blank">www.inertiaspeaks.com</a></div><div dir="ltr"><a href="http://www.inertiagroups.com" target="_blank">www.inertiagroups.com</a></div><div>skype: lokendrarathour</div><div dir="ltr"><img width="200" height="41" src="https://ci3.googleusercontent.com/mail-sig/AIorK4zyd6LpJOGqagxmzUlY59eMQx0-FN0t8HtjdtGE7VLZSKIxBUz3bI7z-MBqbgDVg1-XbtvHgN_ATJ10N6bonyO-JSGTtl5s_mNSbDoXBg"><br></div><div dir="ltr"><br></div></div></div></div></div>
</blockquote></div>
</blockquote></div><br clear="all"><div><br></div>-- <br><div dir="ltr"><div dir="ltr"><div><div dir="ltr"><div dir="ltr">~ Lokendra</div><div dir="ltr"><a href="http://www.inertiaspeaks.com" target="_blank">www.inertiaspeaks.com</a></div><div dir="ltr"><a href="http://www.inertiagroups.com" target="_blank">www.inertiagroups.com</a></div><div>skype: lokendrarathour</div><div dir="ltr"><img width="200" height="41" src="https://ci3.googleusercontent.com/mail-sig/AIorK4zyd6LpJOGqagxmzUlY59eMQx0-FN0t8HtjdtGE7VLZSKIxBUz3bI7z-MBqbgDVg1-XbtvHgN_ATJ10N6bonyO-JSGTtl5s_mNSbDoXBg"><br></div><div dir="ltr"><br></div></div></div></div></div>
</blockquote></div>
</blockquote></div><br clear="all"><div><br></div>-- <br><div dir="ltr"><div dir="ltr"><div><div dir="ltr"><div dir="ltr">~ Lokendra</div><div dir="ltr"><a href="http://www.inertiaspeaks.com" target="_blank">www.inertiaspeaks.com</a></div><div dir="ltr"><a href="http://www.inertiagroups.com" target="_blank">www.inertiagroups.com</a></div><div>skype: lokendrarathour</div><div dir="ltr"><img width="200" height="41" src="https://ci3.googleusercontent.com/mail-sig/AIorK4zyd6LpJOGqagxmzUlY59eMQx0-FN0t8HtjdtGE7VLZSKIxBUz3bI7z-MBqbgDVg1-XbtvHgN_ATJ10N6bonyO-JSGTtl5s_mNSbDoXBg"><br></div><div dir="ltr"><br></div></div></div></div></div>
</blockquote></div>
</blockquote></div><br clear="all"><div><br></div>-- <br><div dir="ltr" class="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div dir="ltr">~ Lokendra</div><div dir="ltr"><a href="http://www.inertiaspeaks.com" target="_blank">www.inertiaspeaks.com</a></div><div dir="ltr"><a href="http://www.inertiagroups.com" target="_blank">www.inertiagroups.com</a></div><div>skype: lokendrarathour</div><div dir="ltr"><img width="200" height="41" src="https://ci3.googleusercontent.com/mail-sig/AIorK4zyd6LpJOGqagxmzUlY59eMQx0-FN0t8HtjdtGE7VLZSKIxBUz3bI7z-MBqbgDVg1-XbtvHgN_ATJ10N6bonyO-JSGTtl5s_mNSbDoXBg"><br></div><div dir="ltr"><br></div></div></div></div></div>