<html>
  <head>
    <meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
  </head>
  <body text="#000000" bgcolor="#FFFFFF">
    <p>Can you talk to the Heat API from your master node? <br>
    </p>
    <p><br>
    </p>
    <div class="moz-cite-prefix">On 20/02/19 6:43 AM, Giuseppe Sannino
      wrote:<br>
    </div>
    <blockquote type="cite"
cite="mid:CABYOS58c+8acMxEv+_WqUW3ec_7E5T69vCYpYVge6C8k9eBkhA@mail.gmail.com">
      <meta http-equiv="content-type" content="text/html; charset=UTF-8">
      <div dir="ltr">
        <div dir="ltr">
          <div dir="ltr">Hi all...again,
            <div>I managed to get over the previous issue by "not
              disabling" the TLS in the cluster template.</div>
            <div>From the cloud-init-output.log I see:</div>
            <div>
              <div><font face="monospace, monospace">Cloud-init v. 17.1
                  running 'modules:final' at Tue, 19 Feb 2019 17:03:53
                  +0000. Up 38.08 seconds.</font></div>
              <div><font face="monospace, monospace">Cloud-init v. 17.1
                  finished at Tue, 19 Feb 2019 17:13:22 +0000.
                  Datasource DataSourceEc2.  Up 607.13 seconds</font></div>
            </div>
            <div><br>
            </div>
            <div>But the cluster creation keeps on failing.</div>
            <div><font face="monospace, monospace">From the journalctl
                -f I see a possible issue:</font></div>
            <div>
              <div><font face="monospace, monospace">Feb 19 17:42:38
                  kube-cluster-tls-6hezqcq4ien3-master-0.novalocal
                  runc[2723]: publicURL endpoint for orchestration
                  service in null region not found</font></div>
              <div><font face="monospace, monospace">Feb 19 17:42:38
                  kube-cluster-tls-6hezqcq4ien3-master-0.novalocal
                  runc[2723]: Source [heat] Unavailable.</font></div>
              <div><font face="monospace, monospace">Feb 19 17:42:38
                  kube-cluster-tls-6hezqcq4ien3-master-0.novalocal
                  runc[2723]: /var/lib/os-collect-config/local-data not
                  found. Skipping</font></div>
            </div>
            <div><br>
            </div>
            <div>anyone familiar with this problem ?</div>
            <div><br>
            </div>
            <div>Thanks as usual.</div>
            <div>/Giuseppe</div>
            <div><br>
            </div>
            <div><br>
            </div>
            <div><br>
            </div>
            <div><br>
            </div>
            <div><br>
            </div>
            <div><br>
            </div>
          </div>
        </div>
      </div>
      <br>
      <div class="gmail_quote">
        <div dir="ltr" class="gmail_attr">On Tue, 19 Feb 2019 at 17:35,
          Giuseppe Sannino <<a
            href="mailto:km.giuseppesannino@gmail.com"
            moz-do-not-send="true">km.giuseppesannino@gmail.com</a>>
          wrote:<br>
        </div>
        <blockquote class="gmail_quote" style="margin:0px 0px 0px
          0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
          <div dir="ltr">
            <div dir="ltr">
              <div dir="ltr">
                <div dir="ltr">
                  <div dir="ltr">Hi all,
                    <div>need an help.</div>
                    <div>I deployed an AIO via Kolla on a baremetal
                      node. Here some information about the deployment:</div>
                    <div>---------------</div>
                    <div>kolla-ansible: 7.0.1</div>
                    <div>openstack_release: Rocky</div>
                    <div>kolla_base_distro: centos</div>
                    <div>kolla_install_type: source</div>
                    <div>TLS: disabled</div>
                    <div>---------------  <br>
                    </div>
                    <div><br>
                    </div>
                    <div><br>
                    </div>
                    <div>VMs spawn without issue but I can't make the
                      "Kubernetes cluster creation" successfully. It
                      fails due to "Time out"</div>
                    <div><br>
                    </div>
                    <div>I managed to log into Kuber Master and from the
                      cloud-init-output.log I can see:</div>
                    <div>
                      <div><font face="monospace, monospace">+ echo
                          'Waiting for Kubernetes API...'</font></div>
                      <div><font face="monospace, monospace">Waiting for
                          Kubernetes API...</font></div>
                      <div><font face="monospace, monospace">++ curl
                          --silent <a
                            href="http://127.0.0.1:8080/healthz"
                            target="_blank" moz-do-not-send="true">http://127.0.0.1:8080/healthz</a></font></div>
                      <div><font face="monospace, monospace">+ '[' ok =
                          '' ']'</font></div>
                      <div><font face="monospace, monospace">+ sleep 5</font></div>
                    </div>
                    <div><br>
                    </div>
                    <div><br>
                    </div>
                    <div>Checking via systemctl and journalctl I see:</div>
                    <div>
                      <div><font face="monospace, monospace">[fedora@kube-clsuter-qamdealetlbi-master-0
                          log]$ systemctl status kube-apiserver</font></div>
                      <div><font face="monospace, monospace">●
                          kube-apiserver.service - kubernetes-apiserver</font></div>
                      <div><font face="monospace, monospace">   Loaded:
                          loaded
                          (/etc/systemd/system/kube-apiserver.service;
                          enabled; vendor preset: disabled)</font></div>
                      <div><font face="monospace, monospace">   Active:
                          failed (Result: exit-code) since Tue
                          2019-02-19 15:31:41 UTC; 45min ago</font></div>
                      <div><font face="monospace, monospace">  Process:
                          3796 ExecStart=/usr/bin/runc --systemd-cgroup
                          run kube-apiserver (code=exited,
                          status=1/FAILURE)</font></div>
                      <div><font face="monospace, monospace"> Main PID:
                          3796 (code=exited, status=1/FAILURE)</font></div>
                      <div><font face="monospace, monospace"><br>
                        </font></div>
                      <div><font face="monospace, monospace">Feb 19
                          15:31:40
                          kube-clsuter-qamdealetlbi-master-0.novalocal
                          systemd[1]: kube-apiserver.service: Main
                          process exited, code=exited, status=1/FAILURE</font></div>
                      <div><font face="monospace, monospace">Feb 19
                          15:31:40
                          kube-clsuter-qamdealetlbi-master-0.novalocal
                          systemd[1]: kube-apiserver.service: Failed
                          with result 'exit-code'.</font></div>
                      <div><font face="monospace, monospace">Feb 19
                          15:31:41
                          kube-clsuter-qamdealetlbi-master-0.novalocal
                          systemd[1]: kube-apiserver.service: Service
                          RestartSec=100ms expired, scheduling restart.</font></div>
                      <div><font face="monospace, monospace">Feb 19
                          15:31:41
                          kube-clsuter-qamdealetlbi-master-0.novalocal
                          systemd[1]: kube-apiserver.service: Scheduled
                          restart job, restart counter is at 6.</font></div>
                      <div><font face="monospace, monospace">Feb 19
                          15:31:41
                          kube-clsuter-qamdealetlbi-master-0.novalocal
                          systemd[1]: Stopped kubernetes-apiserver.</font></div>
                      <div><font face="monospace, monospace">Feb 19
                          15:31:41
                          kube-clsuter-qamdealetlbi-master-0.novalocal
                          systemd[1]: kube-apiserver.service: Start
                          request repeated too quickly.</font></div>
                      <div><font face="monospace, monospace">Feb 19
                          15:31:41
                          kube-clsuter-qamdealetlbi-master-0.novalocal
                          systemd[1]: kube-apiserver.service: Failed
                          with result 'exit-code'.</font></div>
                      <div><font face="monospace, monospace">Feb 19
                          15:31:41
                          kube-clsuter-qamdealetlbi-master-0.novalocal
                          systemd[1]: Failed to start
                          kubernetes-apiserver.</font></div>
                    </div>
                    <div><font face="monospace, monospace"><br>
                      </font></div>
                    <div>
                      <div><font face="monospace, monospace">[fedora@kube-clsuter-qamdealetlbi-master-0
                          log]$ sudo journalctl -u kube-apiserver</font></div>
                      <div><font face="monospace, monospace">-- Logs
                          begin at Tue 2019-02-19 15:21:36 UTC, end at
                          Tue 2019-02-19 16:17:00 UTC. --</font></div>
                      <div><font face="monospace, monospace">Feb 19
                          15:31:33
                          kube-clsuter-qamdealetlbi-master-0.novalocal
                          systemd[1]: Started kubernetes-apiserver.</font></div>
                      <div><font face="monospace, monospace">Feb 19
                          15:31:34
                          kube-clsuter-qamdealetlbi-master-0.novalocal
                          runc[2794]: Flag --insecure-bind-address has
                          been deprecated, This flag will be removed in
                          a future version.</font></div>
                      <div><font face="monospace, monospace">Feb 19
                          15:31:34
                          kube-clsuter-qamdealetlbi-master-0.novalocal
                          runc[2794]: Flag --insecure-port has been
                          deprecated, This flag will be removed in a
                          future version.</font></div>
                      <div><font face="monospace, monospace">Feb 19
                          15:31:35
                          kube-clsuter-qamdealetlbi-master-0.novalocal
                          runc[2794]: Error: error creating self-signed
                          certificates: open
                          /var/run/kubernetes/apiserver.crt: permission
                          denied</font></div>
                    </div>
                    <div><font face="monospace, monospace">:</font></div>
                    <div><font face="monospace, monospace">:</font></div>
                    <div><font face="monospace, monospace">:</font></div>
                    <div>
                      <div><font face="monospace, monospace">Feb 19
                          15:31:35
                          kube-clsuter-qamdealetlbi-master-0.novalocal
                          runc[2794]: error: error creating self-signed
                          certificates: open
                          /var/run/kubernetes/apiserver.crt: permission
                          denied</font></div>
                      <div><font face="monospace, monospace">Feb 19
                          15:31:35
                          kube-clsuter-qamdealetlbi-master-0.novalocal
                          systemd[1]: kube-apiserver.service: Main
                          process exited, code=exited, status=1/FAILURE</font></div>
                      <div><font face="monospace, monospace">Feb 19
                          15:31:35
                          kube-clsuter-qamdealetlbi-master-0.novalocal
                          systemd[1]: kube-apiserver.service: Failed
                          with result 'exit-code'.</font></div>
                      <div><font face="monospace, monospace">Feb 19
                          15:31:35
                          kube-clsuter-qamdealetlbi-master-0.novalocal
                          systemd[1]: kube-apiserver.service: Service
                          RestartSec=100ms expired, scheduling restart.</font></div>
                      <div><font face="monospace, monospace">Feb 19
                          15:31:35
                          kube-clsuter-qamdealetlbi-master-0.novalocal
                          systemd[1]: kube-apiserver.service: Scheduled
                          restart job, restart counter is at 1.</font></div>
                    </div>
                    <div><br>
                    </div>
                    <div><br>
                    </div>
                    <div>May I ask for an help on this ?</div>
                    <div><br>
                    </div>
                    <div>Many thanks</div>
                    <div>/Giuseppe</div>
                    <div><br>
                    </div>
                    <div><br>
                    </div>
                    <div><br>
                    </div>
                    <div>
                      <div><br>
                      </div>
                    </div>
                  </div>
                </div>
              </div>
            </div>
          </div>
        </blockquote>
      </div>
    </blockquote>
    <pre class="moz-signature" cols="72">-- 
Cheers & Best regards,
Feilong Wang (王飞龙)
--------------------------------------------------------------------------
Senior Cloud Software Engineer
Tel: +64-48032246
Email: <a class="moz-txt-link-abbreviated" href="mailto:flwang@catalyst.net.nz">flwang@catalyst.net.nz</a>
Catalyst IT Limited
Level 6, Catalyst House, 150 Willis Street, Wellington
-------------------------------------------------------------------------- </pre>
  </body>
</html>