<div dir="ltr"><span style="font-size:14px">Hello,</span><div style="font-size:14px">Magnum Team.<div><br></div><div>I installed magnum on Openstack Ocata(by fuel 11.0).</div><div>I referred to this guide.(<a href="https://docs.openstack.org/project-install-guide/container-infrastructure-management/ocata/install.html" target="_blank">https://docs.openstack.<wbr>org/project-install-guide/<wbr>container-infrastructure-<wbr>management/ocata/install.html</a>)</div><div><br></div><div>Below is my installation information.</div><div><div>root@controller:~# dpkg -l | grep magnum</div><div>magnum-api                          4.1.0-0ubuntu1~cloud0                      all          OpenStack containers as a service</div><div>magnum-common                       4.1.0-0ubuntu1~cloud0                      all          OpenStack containers as a service - API server</div><div>magnum-conductor                    4.1.0-0ubuntu1~cloud0                      all          OpenStack containers as a service - conductor</div><div>python-magnum                       4.1.0-0ubuntu1~cloud0                      all          OpenStack containers as a service - Python library</div><div>python-magnumclient                 2.5.0-0ubuntu1~cloud0                      all          client library for Magnum API - Python 2.x</div></div><div><br></div><div>After installation,</div><div>I created cluster-template for kubernetes like this.</div><div><span style="color:rgb(0,0,0);font-family:arial;font-size:13px;white-space:pre-wrap">(magnum cluster-template-create --name k8s-cluster-template \
                       --image fedora-atomic-latest \
                       --keypair testkey \
                       --external-network admin_floating_net \
                       --dns-nameserver 8.8.8.8 \
                       --flavor m1.small \
                       --docker-volume-size 5 \
                       --network-driver flannel \
                       --coe kubernetes  )</span><br></div><div><span style="color:rgb(0,0,0);font-family:arial;font-size:13px;white-space:pre-wrap"><br></span></div><div><font color="#000000" face="arial"><span style="white-space:pre-wrap">and I create cluster, </span></font></div><div><font color="#000000" face="arial"><span style="white-space:pre-wrap">b</span></font>ut "magnum clutser-create' command was failed.</div><div><span style="color:rgb(0,0,0);font-family:arial;font-size:13px;white-space:pre-wrap">(magnum cluster-create --name k8s-cluster \
                      --cluster-template k8s-cluster-template \
                      --node-count 1 \
                      --timeout 10   )</span><br></div><div><span style="color:rgb(0,0,0);font-family:arial;font-size:13px;white-space:pre-wrap"><br></span></div><div><span style="color:rgb(0,0,0);font-family:arial;font-size:13px;white-space:pre-wrap">After 10 minutes(option "--timeout 10"),</span></div><div><font color="#000000" face="arial"><span style="white-space:pre-wrap">creation was failed, and the status is "CREATE_FAILED"</span></font></div><div><font color="#000000" face="arial"><span style="white-space:pre-wrap"><br></span></font></div><div><font color="#000000" face="arial"><span style="white-space:pre-wrap">I executed "openstack server list" command,</span></font></div><div><font color="#000000" face="arial"><span style="white-space:pre-wrap">there is a only kube-master instance. </span></font></div><div><font color="#000000" face="arial"><span style="white-space:pre-wrap">(</span></font>root@controller:~# openstack server list</div><div><div>+-----------------------------<wbr>---------+--------------------<wbr>-------------------+--------+-<wbr>------------------------------<wbr>-+----------------------+</div><div>| ID                                   | Name                                  | Status | Networks                       | Image Name           |</div><div>+-----------------------------<wbr>---------+--------------------<wbr>-------------------+--------+-<wbr>------------------------------<wbr>-+----------------------+</div><div>| bf9c5097-74fd-4457-a8a2-<wbr>4feae76d4111 | k8-i27fw72w5t-0-i6lg6mzpzrl6-<wbr>kube-    | ACTIVE | private=10.0.0.9, 172.16.1.135 | fedora-atomic-latest |</div><div>|                                      | master-ekjrg2v6ztss                   |        |                                |                      |</div><div>+-----------------------------<wbr>---------+--------------------<wbr>-------------------+--------+-<wbr>------------------------------<wbr>-+----------------------+    </div></div><div>)</div><div><br></div><div>I think kube-master instance create is successful.</div><div>I can connect that instance</div><div>and docker container was running normally.</div><div><br></div><div>Why this command was failed?</div><div><br></div><div>Here is my /var/log/magnum/magnum-<wbr>conductor.log and /var/log/nova-all.log.</div><div>magnum-conductor.log have a ERROR.</div><div>==============================<wbr>=================</div><div><div>2017-05-12 04:05:00.684 756 ERROR magnum.common.keystone [req-e2d4ea12-ec7a-4865-9eda-<wbr>d272cc43a827 - - - - -] Keystone API connection failed: no password, trust_id or token found.</div><div>2017-05-12 04:05:00.686 756 ERROR magnum.common.exception [req-e2d4ea12-ec7a-4865-9eda-<wbr>d272cc43a827 - - - - -] Exception in string format operation, kwargs: {'code': 500}</div><div>2017-05-12 04:05:00.686 756 ERROR magnum.common.exception Traceback (most recent call last):</div><div>2017-05-12 04:05:00.686 756 ERROR magnum.common.exception   File "/usr/lib/python2.7/dist-<wbr>packages/magnum/common/<wbr>exception.py", line 92, in __init__</div><div>2017-05-12 04:05:00.686 756 ERROR magnum.common.exception     self.message = self.message % kwargs</div><div>2017-05-12 04:05:00.686 756 ERROR magnum.common.exception KeyError: u'client'</div><div>2017-05-12 04:05:00.686 756 ERROR magnum.common.exception</div><div>2017-05-12 04:05:00.687 756 ERROR oslo.service.loopingcall [req-e2d4ea12-ec7a-4865-9eda-<wbr>d272cc43a827 - - - - -] Fixed interval looping call 'magnum.service.periodic.<wbr>ClusterUpdateJob.update_<wbr>status' failed</div><div>2017-05-12 04:05:00.687 756 ERROR oslo.service.loopingcall Traceback (most recent call last):</div><div>2017-05-12 04:05:00.687 756 ERROR oslo.service.loopingcall   File "/usr/lib/python2.7/dist-<wbr>packages/oslo_service/<wbr>loopingcall.py", line 137, in _run_loop</div><div>2017-05-12 04:05:00.687 756 ERROR oslo.service.loopingcall     result = func(*self.args, **<a href="http://self.kw/" target="_blank">self.kw</a>)</div><div>2017-05-12 04:05:00.687 756 ERROR oslo.service.loopingcall   File "/usr/lib/python2.7/dist-<wbr>packages/magnum/service/<wbr>periodic.py", line 71, in update_status</div><div>2017-05-12 04:05:00.687 756 ERROR oslo.service.loopingcall     cdriver.update_cluster_status(<wbr>self.ctx, self.cluster)</div><div>2017-05-12 04:05:00.687 756 ERROR oslo.service.loopingcall   File "/usr/lib/python2.7/dist-<wbr>packages/magnum/drivers/heat/<wbr>driver.py", line 80, in update_cluster_status</div><div>2017-05-12 04:05:00.687 756 ERROR oslo.service.loopingcall     poller.poll_and_check()</div><div>2017-05-12 04:05:00.687 756 ERROR oslo.service.loopingcall   File "/usr/lib/python2.7/dist-<wbr>packages/magnum/drivers/heat/<wbr>driver.py", line 169, in poll_and_check</div><div>2017-05-12 04:05:00.687 756 ERROR oslo.service.loopingcall     stack = self.openstack_client.heat().<wbr>stacks.get(</div><div>2017-05-12 04:05:00.687 756 ERROR oslo.service.loopingcall   File "/usr/lib/python2.7/dist-<wbr>packages/magnum/common/<wbr>exception.py", line 59, in wrapped</div><div>2017-05-12 04:05:00.687 756 ERROR oslo.service.loopingcall     return func(*args, **kw)</div><div>2017-05-12 04:05:00.687 756 ERROR oslo.service.loopingcall   File "/usr/lib/python2.7/dist-<wbr>packages/magnum/common/<wbr>clients.py", line 94, in heat</div><div>2017-05-12 04:05:00.687 756 ERROR oslo.service.loopingcall     region_name=region_name)</div><div>2017-05-12 04:05:00.687 756 ERROR oslo.service.loopingcall   File "/usr/lib/python2.7/dist-<wbr>packages/magnum/common/<wbr>clients.py", line 45, in url_for</div><div>2017-05-12 04:05:00.687 756 ERROR oslo.service.loopingcall     return self.keystone().session.get_<wbr>endpoint(**kwargs)</div><div>2017-05-12 04:05:00.687 756 ERROR oslo.service.loopingcall   File "/usr/lib/python2.7/dist-<wbr>packages/magnum/common/<wbr>keystone.py", line 59, in session</div><div>2017-05-12 04:05:00.687 756 ERROR oslo.service.loopingcall     auth = self._get_auth()</div><div>2017-05-12 04:05:00.687 756 ERROR oslo.service.loopingcall   File "/usr/lib/python2.7/dist-<wbr>packages/magnum/common/<wbr>keystone.py", line 98, in _get_auth</div><div>2017-05-12 04:05:00.687 756 ERROR oslo.service.loopingcall     raise exception.<wbr>AuthorizationFailure()</div><div>2017-05-12 04:05:00.687 756 ERROR oslo.service.loopingcall AuthorizationFailure: %(client)s connection failed. %(message)s</div><div>2017-05-12 04:05:00.687 756 ERROR oslo.service.loopingcall</div><div>2017-05-12 04:10:11.634 756 ERROR magnum.drivers.heat.driver [req-7bf01756-8b81-4387-8512-<wbr>e29cd2b71aab - - - - -] Cluster error, stack status: CREATE_FAILED, stack_id: c1bf3ab0-c869-458d-a16d-<wbr>6f4ab8284046, reason: Timed out</div></div><div>==============================<wbr>=================<br></div><div><br></div><div>And, heat-all.log has same logging repeatedly.</div><div>==============================<wbr>=================<br></div><div><div>2017-05-12T04:09:58.514153+00:<wbr>00 controller heat-engine: 2017-05-12 04:09:58.512 8813 DEBUG heat.engine.scheduler [req-90ba259d-abef-4d45-a87e-<wbr>0c08cbd5a4ae -</div><div>- - - -] Task create from HeatWaitCondition "master_wait_condition" Stack "k8s-cluster-nyj64j3yjhjs-<wbr>kube_masters-k6i27fw72w5t-0-<wbr>i6lg6mzpzrl6" [57626786-4858-4</div><div>715-9c01-97ad6156d6f7] running step /usr/lib/python2.7/dist-<wbr>packages/heat/engine/<wbr>scheduler.py:215</div><div>2017-05-12T04:09:58.532625+00:<wbr>00 controller heat-engine: 2017-05-12 04:09:58.531 8813 DEBUG heat.engine.scheduler [req-90ba259d-abef-4d45-a87e-<wbr>0c08cbd5a4ae -</div><div>- - - -] Task create from HeatWaitCondition "master_wait_condition" Stack "k8s-cluster-nyj64j3yjhjs-<wbr>kube_masters-k6i27fw72w5t-0-<wbr>i6lg6mzpzrl6" [57626786-4858-4</div><div>715-9c01-97ad6156d6f7] sleeping _sleep /usr/lib/python2.7/dist-<wbr>packages/heat/engine/<wbr>scheduler.py:156</div><div>2017-05-12T04:09:58.740335+00:<wbr>00 controller heat-engine: 2017-05-12 04:09:58.738 8879 DEBUG heat.engine.scheduler [req-e0532cce-e310-4222-80d9-<wbr>159c9aee6afa -</div><div>- - - -] Task create from TemplateResource "0" Stack "k8s-cluster-nyj64j3yjhjs-<wbr>kube_masters-k6i27fw72w5t" [093664fa-7914-41a3-924e-<wbr>7e5706320301] running step</div><div>/usr/lib/python2.7/dist-<wbr>packages/heat/engine/<wbr>scheduler.py:215</div><div>2017-05-12T04:09:58.746408+00:<wbr>00 controller heat-engine: 2017-05-12 04:09:58.745 8879 DEBUG heat.engine.scheduler [req-e0532cce-e310-4222-80d9-<wbr>159c9aee6afa -</div><div>- - - -] Task create from TemplateResource "0" Stack "k8s-cluster-nyj64j3yjhjs-<wbr>kube_masters-k6i27fw72w5t" [093664fa-7914-41a3-924e-<wbr>7e5706320301] sleeping _sle</div><div>ep /usr/lib/python2.7/dist-<wbr>packages/heat/engine/<wbr>scheduler.py:156</div><div>2017-05-12T04:09:58.980256+00:<wbr>00 controller heat-engine: 2017-05-12 04:09:58.979 8847 DEBUG heat.engine.scheduler [req-fade682c-de27-4d9d-8756-<wbr>67f6ebd5ffc4 -</div><div>- - - -] Task create from ResourceGroup "kube_masters" Stack "k8s-cluster-nyj64j3yjhjs" [c1bf3ab0-c869-458d-a16d-<wbr>6f4ab8284046] running step /usr/lib/python2.7</div><div>/dist-packages/heat/engine/<wbr>scheduler.py:215</div><div>2017-05-12T04:09:58.986982+00:<wbr>00 controller heat-engine: 2017-05-12 04:09:58.985 8847 DEBUG heat.engine.scheduler [req-fade682c-de27-4d9d-8756-<wbr>67f6ebd5ffc4 -</div><div>- - - -] Task create from ResourceGroup "kube_masters" Stack "k8s-cluster-nyj64j3yjhjs" [c1bf3ab0-c869-458d-a16d-<wbr>6f4ab8284046] sleeping _sleep /usr/lib/python</div><div>2.7/dist-packages/heat/engine/<wbr>scheduler.py:156</div><div>2017-05-12T04:09:59.533940+00:<wbr>00 controller heat-engine: 2017-05-12 04:09:59.532 8813 DEBUG heat.engine.scheduler [req-90ba259d-abef-4d45-a87e-<wbr>0c08cbd5a4ae -</div><div>- - - -] Task create from HeatWaitCondition "master_wait_condition" Stack "k8s-cluster-nyj64j3yjhjs-<wbr>kube_masters-k6i27fw72w5t-0-<wbr>i6lg6mzpzrl6" [57626786-4858-4</div><div>715-9c01-97ad6156d6f7] running step /usr/lib/python2.7/dist-<wbr>packages/heat/engine/<wbr>scheduler.py:215</div><div>2017-05-12T04:09:59.554131+00:<wbr>00 controller heat-engine: 2017-05-12 04:09:59.553 8813 DEBUG heat.engine.scheduler [req-90ba259d-abef-4d45-a87e-<wbr>0c08cbd5a4ae -</div><div>- - - -] Task create from HeatWaitCondition "master_wait_condition" Stack "k8s-cluster-nyj64j3yjhjs-<wbr>kube_masters-k6i27fw72w5t-0-<wbr>i6lg6mzpzrl6" [57626786-4858-4</div><div>715-9c01-97ad6156d6f7] sleeping _sleep /usr/lib/python2.7/dist-<wbr>packages/heat/engine/<wbr>scheduler.py:156</div><div>2017-05-12T04:09:59.747987+00:<wbr>00 controller heat-engine: 2017-05-12 04:09:59.746 8879 DEBUG heat.engine.scheduler [req-e0532cce-e310-4222-80d9-<wbr>159c9aee6afa -</div><div>- - - -] Task create from TemplateResource "0" Stack "k8s-cluster-nyj64j3yjhjs-<wbr>kube_masters-k6i27fw72w5t" [093664fa-7914-41a3-924e-<wbr>7e5706320301] running step</div><div>/usr/lib/python2.7/dist-<wbr>packages/heat/engine/<wbr>scheduler.py:215</div><div>2017-05-12T04:09:59.764422+00:<wbr>00 controller heat-engine: 2017-05-12 04:09:59.755 8879 DEBUG heat.engine.scheduler [req-e0532cce-e310-4222-80d9-<wbr>159c9aee6afa -</div><div>- - - -] Task create from TemplateResource "0" Stack "k8s-cluster-nyj64j3yjhjs-<wbr>kube_masters-k6i27fw72w5t" [093664fa-7914-41a3-924e-<wbr>7e5706320301] sleeping _sle</div><div>ep /usr/lib/python2.7/dist-<wbr>packages/heat/engine/<wbr>scheduler.py:156</div><div>2017-05-12T04:09:59.989512+00:<wbr>00 controller heat-engine: 2017-05-12 04:09:59.987 8847 DEBUG heat.engine.scheduler [req-fade682c-de27-4d9d-8756-<wbr>67f6ebd5ffc4 -</div><div>- - - -] Task create from ResourceGroup "kube_masters" Stack "k8s-cluster-nyj64j3yjhjs" [c1bf3ab0-c869-458d-a16d-<wbr>6f4ab8284046] running step /usr/lib/python2.7</div><div>/dist-packages/heat/engine/<wbr>scheduler.py:215</div><div>2017-05-12T04:09:59.997531+00:<wbr>00 controller heat-engine: 2017-05-12 04:09:59.996 8847 DEBUG heat.engine.scheduler [req-fade682c-de27-4d9d-8756-<wbr>67f6ebd5ffc4 -</div><div>- - - -] Task create from ResourceGroup "kube_masters" Stack "k8s-cluster-nyj64j3yjhjs" [c1bf3ab0-c869-458d-a16d-<wbr>6f4ab8284046] sleeping _sleep /usr/lib/python</div><div>2.7/dist-packages/heat/engine/<wbr>scheduler.py:156</div></div><div>...<br><div>==============================<wbr>=================<br></div><div></div></div><div><br></div><div>Thank you.<br></div><div>Best Regards.</div></div></div>