<div dir="ltr"><div dir="ltr"><div>Hi Ignazio,</div><div><br></div><div>I think my problem is from this file to,</div><div><br></div><div>[fedora@swarm-cluster-hekxryp2n6ke-primary-master-0 ~]$ sudo cat /etc/sysconfig/heat-params<br>IS_PRIMARY_MASTER="True"<br>WAIT_CURL="curl -i -X POST -H 'X-Auth-Token: gAAAAABcFVD3Lq8v3cBGbpnejxNtqkDZPIDBYg6LBXTifXQxPowzdWhYHnRT7MWE48fwPwTYTJxM6TS_v32gl4OZu5GInufoXmnBFApdOmUg9KzeJGz8iGvg0tl62ratgRN40SMXNM7ZEXIflDQHO9tKrVdpJ9v6KY8HV2rZ0mspzTUDnsg0NjE' -H 'Content-Type: application/json' -H 'Accept: application/json' <a href="http://10.60.60.10:8004/v1/c508af1f5ad741dbb2e3e2b5eee5855e/stacks/swarm-cluster-hekxryp2n6ke-swarm_primary_master-hkgjpiv34bcl-0-323fkifz7mim/a5cabefd-417c-41ad-bf43-2ab27d572d08/resources/master_wait_handle/signal">http://10.60.60.10:8004/v1/c508af1f5ad741dbb2e3e2b5eee5855e/stacks/swarm-cluster-hekxryp2n6ke-swarm_primary_master-hkgjpiv34bcl-0-323fkifz7mim/a5cabefd-417c-41ad-bf43-2ab27d572d08/resources/master_wait_handle/signal</a>"<br>DOCKER_VOLUME="6101c99c-9072-4290-9691-e679dbb44f8f"<br>DOCKER_VOLUME_SIZE="0"<br>DOCKER_STORAGE_DRIVER="devicemapper"<br>HTTP_PROXY=""<br>HTTPS_PROXY=""<br>NO_PROXY=""<br>PRIMARY_MASTER_IP=""<br>SWARM_API_IP="10.0.0.13"<br>SWARM_NODE_IP="10.0.0.13"<br>CLUSTER_UUID="17a9eb19-2d22-473a-a292-df2d06197974"<br>MAGNUM_URL="<a href="http://10.60.60.10:9511/v1">http://10.60.60.10:9511/v1</a>"<br>TLS_DISABLED="False"<br>API_IP_ADDRESS="10.61.61.111"<br>TRUSTEE_USER_ID="f61ff2de879548e9b46bd5609a696b6c"<br>TRUSTEE_PASSWORD="T6zjpQGjqcPwv7684F"<br>TRUST_ID=""<br>AUTH_URL="<a href="http://10.60.60.10:5000/v3">http://10.60.60.10:5000/v3</a>"<br>VOLUME_DRIVER=""<br>REXRAY_PREEMPT="false"<br>VERIFY_CA="True"<br></div><div><div><div dir="ltr" class="gmail_signature"><div dir="ltr"><span><div><span style="font-family:arial,helvetica,sans-serif"><span lang="en"><span><br></span></span></span></div><div><span style="font-family:arial,helvetica,sans-serif"><span lang="en"><span>Best Regards,<br></span></span></span></div><span lang="en"><span><span style="font-family:arial,helvetica,sans-serif">Zufar Dhiyaulhaq</span></span></span></span></div></div></div><br></div></div></div><br><div class="gmail_quote"><div dir="ltr">On Sun, Dec 16, 2018 at 2:09 AM Zufar Dhiyaulhaq <<a href="mailto:zufar@onf-ambassador.org">zufar@onf-ambassador.org</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div>Hi, Ignazio,</div><div><br></div><div>yes all of my endpoint is in 10.60.60.</div><div><br></div><div>Ignazio, can you check `sudo cat /etc/sysconfig/heat-params` inside the VM and see `DOCKER_VOLUME_SIZE="0"`</div><div>Maybe this give you solution.<br></div><div><div><div dir="ltr" class="gmail-m_7965431031104955279gmail_signature"><div dir="ltr"><span><div><span style="font-family:arial,helvetica,sans-serif"><span lang="en"><span><br></span></span></span></div><div><span style="font-family:arial,helvetica,sans-serif"><span lang="en"><span>Best Regards,<br></span></span></span></div><span lang="en"><span><span style="font-family:arial,helvetica,sans-serif">Zufar Dhiyaulhaq</span></span></span></span></div></div></div><br></div></div></div></div><br><div class="gmail_quote"><div dir="ltr">On Sun, Dec 16, 2018 at 2:03 AM Ignazio Cassano <<a href="mailto:ignaziocassano@gmail.com" target="_blank">ignaziocassano@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="auto"><div dir="auto"></div>Pobably you configured all services<div dir="auto">(Nova , magnum and so on) with endpoint on 10.60.60..... in keystone section </div><div dir="auto"><br></div><div dir="auto"><div class="gmail_quote" dir="auto"><div dir="ltr">Il giorno Sab 15 Dic 2018 19:39 Zufar Dhiyaulhaq <<a href="mailto:zufar@onf-ambassador.org" rel="noreferrer" target="_blank">zufar@onf-ambassador.org</a>> ha scritto:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div>Hi Ignazio,</div><div><br></div><div>I try to change the heat configuration as you suggested, but still my instance are try to 10.60.60.10.</div><div>this is the output :</div><div><br></div><div>| 0c34c8b0dcdc459f818c2bab04913039 | RegionOne | keystone     | identity        | True    | public    | <a href="http://10.60.60.10:5000/v3" rel="noreferrer noreferrer" target="_blank">http://10.60.60.10:5000/v3</a>                 |<br>| 8ca42fccdb774f9daf67c95ea61fd006 | RegionOne | keystone     | identity        | True    | admin     | <a href="http://10.60.60.10:35357/v3" rel="noreferrer noreferrer" target="_blank">http://10.60.60.10:35357/v3</a>                |<br>| 8d0a23730608495980dce151d466a579 | RegionOne | keystone     | identity        | True    | internal  | <a href="http://10.60.60.10:5000/v3" rel="noreferrer noreferrer" target="_blank">http://10.60.60.10:5000/v3</a>                 |<br></div><div><br></div><div>testing curl :</div><div><br></div><div>@swarm-cluster-wtet5ppc5eqi-primary-master-0 ~]$ curl <a href="http://10.60.60.10:5000/v3" rel="noreferrer noreferrer" target="_blank">http://10.60.60.10:5000/v3</a><br>^C<br>[fedora@swarm-cluster-wtet5ppc5eqi-primary-master-0 ~]$ curl <a href="http://10.61.61.10:5000/v3" rel="noreferrer noreferrer" target="_blank">http://10.61.61.10:5000/v3</a><br>{"version": {"status": "stable", "updated": "2018-02-28T00:00:00Z", "media-types": [{"base": "application/json", "type": "application/vnd.openstack.identity-v3+json"}], "id": "v3.10", "links": [{"href": "<a href="http://10.61.61.10:5000/v3/" rel="noreferrer noreferrer" target="_blank">http://10.61.61.10:5000/v3/</a>", "rel": "self"}]}}[fedora@swarm-cluster-wtet5ppc5eqi-primary-master-0 ~]$<br></div><div><br></div><div><div><div dir="ltr" class="gmail-m_7965431031104955279gmail-m_6242380133510512632m_-4758286766531774635m_6670615716513026435gmail_signature"><div dir="ltr"><span><div><span style="font-family:arial,helvetica,sans-serif"><span lang="en"><span><br></span></span></span></div><div><span style="font-family:arial,helvetica,sans-serif"><span lang="en"><span>Best Regards,<br></span></span></span></div><span lang="en"><span><span style="font-family:arial,helvetica,sans-serif">Zufar Dhiyaulhaq</span></span></span></span></div></div></div><br></div></div></div></div><br><div class="gmail_quote"><div dir="ltr">On Sun, Dec 16, 2018 at 1:20 AM Ignazio Cassano <<a href="mailto:ignaziocassano@gmail.com" rel="noreferrer noreferrer" target="_blank">ignaziocassano@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="auto">What reports the command <div dir="auto">openstack endpoint list | grep keystone</div><div dir="auto"><br></div><div dir="auto">?</div><div dir="auto"><br></div></div><br><div class="gmail_quote"><div dir="ltr">Il giorno Sab 15 Dic 2018 19:16 Zufar Dhiyaulhaq <<a href="mailto:zufar@onf-ambassador.org" rel="noreferrer noreferrer" target="_blank">zufar@onf-ambassador.org</a>> ha scritto:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div dir="ltr"><div>By Design, my OpenStack have 2 networks.</div><div><br></div><div>External Network (Floating IP) : <a href="http://10.61.61.0/24" rel="noreferrer noreferrer noreferrer" target="_blank">10.61.61.0/24</a><br></div><div>Management Network & Data Network (private): <a href="http://10.60.60.0/24" rel="noreferrer noreferrer noreferrer" target="_blank">10.60.60.0/24</a></div><div><br></div><div>An instance that deploys with floating IP cant access to the management network. It is possible to change the URL from the error log (10.60.60.10) to 10.61.61.10? </div><div><div><div dir="ltr" class="gmail-m_7965431031104955279gmail-m_6242380133510512632m_-4758286766531774635m_6670615716513026435gmail-m_-2045637540384588387m_7790908788062767225gmail_signature"><div dir="ltr"><span><div><span style="font-family:arial,helvetica,sans-serif"><span lang="en"><span><br></span></span></span></div><div><span style="font-family:arial,helvetica,sans-serif"><span lang="en"><span>Best Regards,<br></span></span></span></div><span lang="en"><span><span style="font-family:arial,helvetica,sans-serif">Zufar Dhiyaulhaq</span></span></span></span></div></div></div><br></div></div><br><div class="gmail_quote"><div dir="ltr">On Sun, Dec 16, 2018 at 1:12 AM Zufar Dhiyaulhaq <<a href="mailto:zufar@onf-ambassador.org" rel="noreferrer noreferrer noreferrer" target="_blank">zufar@onf-ambassador.org</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div>Yes. Master Node communicates with port 5000, but with a wrong IP address.</div><div><br></div><div>Floating IP give to my instance is in <a href="http://10.61.61.0/24" rel="noreferrer noreferrer noreferrer" target="_blank">10.61.61.0/24</a> but all of my endpoints are in <a href="http://10.60.60.0/24" rel="noreferrer noreferrer noreferrer" target="_blank">10.60.60.0/24</a>, but when I try to curl manual the endpoint with <a href="http://10.61.61.0/24" rel="noreferrer noreferrer noreferrer" target="_blank">10.61.61.0/24</a> it's working fine. <br></div><div>It is possible to change the IP address installed on cloud-init to 10.61.61.X?<br></div><div><div><div dir="ltr" class="gmail-m_7965431031104955279gmail-m_6242380133510512632m_-4758286766531774635m_6670615716513026435gmail-m_-2045637540384588387m_7790908788062767225gmail-m_1803969138324256335gmail_signature"><div dir="ltr"><span><div><span style="font-family:arial,helvetica,sans-serif"><span lang="en"><span><br></span></span></span></div><div><span style="font-family:arial,helvetica,sans-serif"><span lang="en"><span>Best Regards,<br></span></span></span></div><span lang="en"><span><span style="font-family:arial,helvetica,sans-serif">Zufar Dhiyaulhaq</span></span></span></span></div></div></div><br></div></div><br><div class="gmail_quote"><div dir="ltr">On Sun, Dec 16, 2018 at 1:08 AM Ignazio Cassano <<a href="mailto:ignaziocassano@gmail.com" rel="noreferrer noreferrer noreferrer" target="_blank">ignaziocassano@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="auto"><div dir="auto"></div>Zufar, the master node must communicat with port 5000 on the network where you deployed keystone endpoint.<div dir="auto">Ignazio<br><div class="gmail_quote" dir="auto"><div dir="ltr">Il giorno Sab 15 Dic 2018 18:58 Zufar Dhiyaulhaq <<a href="mailto:zufar@onf-ambassador.org" rel="noreferrer noreferrer noreferrer noreferrer" target="_blank">zufar@onf-ambassador.org</a>> ha scritto:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div>Hi I am creating a swarm cluster with this command :<br></div><ul><li>openstack coe cluster template create swarm-cluster-template --image fedora-atomic-latest --external-network external --dns-nameserver 8.8.8.8 --master-flavor m1.small --flavor m1.small --coe swarm-mode --docker-volume-size 4 --docker-storage-driver=devicemapper</li><li>openstack coe cluster create swarm-cluster --cluster-template swarm-cluster-template --master-count 1 --node-count 1 --keypair mykey</li></ul><div>but its stack on <b>swarm_primary_master </b>heat with <b>CREATE_IN_PROGRESS</b>. I try to login into swarm VM and see the log.</div><div><br></div><div>I get this :</div><div><br></div><div><ul><li>requests.exceptions.ConnectionError: HTTPConnectionPool(host='10.60.60.10', port=5000): Max retries exceeded with url: /v3/auth/tokens (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f02f57321d0>: Failed to establish a new connection: [Errno 110] Connection timed out',))</li><li>Cloud-init v. 0.7.9 running 'modules:final' at Sat, 15 Dec 2018 17:36:44 +0000. Up 33.29 seconds.</li></ul><br></div><div>Swarm Instance try to open connection to 10.60.60.10 which is my management ip address on OpenStack.  But it cannot (by design it cannot, I try to curl manual to 10.60.60.10 and error). When curl to 10.61.61.10 which is my floating IP and external IP for OpenStack cluster, it works.</div><div><br></div><div>Anyone know how to change the cloud-init to curl into 10.61.61.10?<br></div><div><div><div dir="ltr" class="gmail-m_7965431031104955279gmail-m_6242380133510512632m_-4758286766531774635m_6670615716513026435gmail-m_-2045637540384588387m_7790908788062767225gmail-m_1803969138324256335gmail-m_5792017765612896844m_5489633176588292018m_3928594427421150465gmail_signature"><div dir="ltr"><span><div><span style="font-family:arial,helvetica,sans-serif"><span lang="en"><span><br></span></span></span></div><div><span style="font-family:arial,helvetica,sans-serif"><span lang="en"><span>Best Regards,<br></span></span></span></div><span lang="en"><span><span style="font-family:arial,helvetica,sans-serif">Zufar Dhiyaulhaq</span></span></span></span></div></div></div></div></div></div></div></div></div></div>
</blockquote></div></div></div>
</blockquote></div>
</blockquote></div></div>
</blockquote></div>
</blockquote></div>
</blockquote></div></div></div>
</blockquote></div>
</blockquote></div>