<div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div>Hi Ignazio,</div><div><br></div><div>this is my Heat Configuration :</div><div><br></div><div>[root@zu-controller0 ~(keystone_admin)]# egrep -v ^'(#|$)' /etc/heat/heat.conf                                    <br>[DEFAULT]<br>heat_metadata_server_url=<a href="http://10.60.60.10:8000">http://10.60.60.10:8000</a><br>heat_waitcondition_server_url=<a href="http://10.60.60.10:8000/v1/waitcondition">http://10.60.60.10:8000/v1/waitcondition</a><br>heat_watch_server_url=<a href="http://10.60.60.10:8003">http://10.60.60.10:8003</a><br>stack_user_domain_name=heat<br>stack_domain_admin=heat_admin<br>stack_domain_admin_password=b2464b7fd4694efa<br>num_engine_workers=4<br>auth_encryption_key=d954b3c680fd42fb<br>debug=False<br>log_dir=/var/log/heat<br>transport_url=rabbit://<a href="http://guest:guest@10.60.60.10:5672/">guest:guest@10.60.60.10:5672/</a><br>[auth_password]<br>[clients]<br>[clients_aodh]<br>[clients_barbican]<br>[clients_ceilometer]<br>[clients_cinder]<br>[clients_designate]<br>[clients_glance]<br>[clients_heat]<br>[clients_keystone]<br>auth_uri=<a href="http://10.61.61.10:35357">http://10.61.61.10:35357</a><br>[clients_magnum]<br>[clients_manila][root@zu-controller0 ~(keystone_admin)]# egrep -v ^'(#|$)' /etc/heat/heat.conf                                    <br>[DEFAULT]<br>heat_metadata_server_url=<a href="http://10.60.60.10:8000">http://10.60.60.10:8000</a><br>heat_waitcondition_server_url=<a href="http://10.60.60.10:8000/v1/waitcondition">http://10.60.60.10:8000/v1/waitcondition</a><br>heat_watch_server_url=<a href="http://10.60.60.10:8003">http://10.60.60.10:8003</a><br>stack_user_domain_name=heat<br>stack_domain_admin=heat_admin<br>stack_domain_admin_password=b2464b7fd4694efa<br>num_engine_workers=4<br>auth_encryption_key=d954b3c680fd42fb<br>debug=False<br>log_dir=/var/log/heat<br>transport_url=rabbit://<a href="http://guest:guest@10.60.60.10:5672/">guest:guest@10.60.60.10:5672/</a><br>[auth_password]<br>[clients]<br>[clients_aodh]<br>[clients_barbican]<br>[clients_ceilometer]<br>[clients_cinder]<br>[clients_designate]<br>[clients_glance]<br>[clients_heat]<br>[clients_keystone]<br>auth_uri=<a href="http://10.61.61.10:35357">http://10.61.61.10:35357</a><br>[clients_magnum]<br>[clients_manila]<br>[clients_mistral]<br>[clients_monasca]<br>[clients_neutron]<br>[clients_nova]<br>[clients_octavia]<br>[clients_sahara]<br>[clients_senlin]<br>[clients_swift]<br>[clients_trove]<br>[clients_zaqar]<br>[cors]<br>[database]<br>connection=mysql+pymysql://<a href="http://heat:c553beb7ef5e4ac6@10.60.60.10/heat">heat:c553beb7ef5e4ac6@10.60.60.10/heat</a><br>[ec2authtoken]<br>auth_uri=<a href="http://10.61.61.10:5000/v3">http://10.61.61.10:5000/v3</a><br>[eventlet_opts]<br>[healthcheck]<br>[heat_api]<br>workers=4<br>[heat_api_cfn]<br>workers=4<br>[heat_api_cloudwatch]<br>[matchmaker_redis]<br>[noauth]<br>[oslo_messaging_amqp]<br>[oslo_messaging_kafka]<br>[oslo_messaging_notifications]<br>[oslo_messaging_rabbit]<br>ssl=False<br>[oslo_messaging_zmq]<br>[oslo_middleware]<br>[oslo_policy]<br>policy_file=/etc/heat/policy.json<br>[paste_deploy]<br>[profiler]<br>[revision]<br>[ssl]<br>[trustee]<br>auth_type=password<br>auth_url=<a href="http://10.60.60.10:35357">http://10.60.60.10:35357</a><br>project_domain_name=Default<br>username=heat<br>user_domain_name=Default<br>password=c9b4b2e3fd704048<br>[volumes]<br>[keystone_authtoken]<br>auth_uri=<a href="http://10.60.60.10:5000/v3">http://10.60.60.10:5000/v3</a><br>auth_type=password<br>auth_url=<a href="http://10.60.60.10:35357">http://10.60.60.10:35357</a><br>username=heat<br>password=c9b4b2e3fd704048<br>user_domain_name=Default<br>project_name=services<br>project_domain_name=Default<br>[clients_mistral]<br>[clients_monasca]<br>[clients_neutron]<br>[clients_nova]<br>[clients_octavia]<br>[clients_sahara]<br>[clients_senlin]<br>[clients_swift]<br>[clients_trove]<br>[clients_zaqar]<br>[cors]<br>[database]<br>connection=mysql+pymysql://<a href="http://heat:c553beb7ef5e4ac6@10.60.60.10/heat">heat:c553beb7ef5e4ac6@10.60.60.10/heat</a><br>[ec2authtoken]<br>auth_uri=<a href="http://10.61.61.10:5000/v3">http://10.61.61.10:5000/v3</a><br>[eventlet_opts]<br>[healthcheck]<br>[heat_api]<br>workers=4<br>[heat_api_cfn]<br>workers=4<br>[heat_api_cloudwatch]<br>[matchmaker_redis]<br>[noauth]<br>[oslo_messaging_amqp]<br>[oslo_messaging_kafka]<br>[oslo_messaging_notifications]<br>[oslo_messaging_rabbit]<br>ssl=False<br>[oslo_messaging_zmq]<br>[oslo_middleware]<br>[oslo_policy]<br>policy_file=/etc/heat/policy.json<br>[paste_deploy]<br>[profiler]<br>[revision]<br>[ssl]<br>[trustee]<br>auth_type=password<br>auth_url=<a href="http://10.60.60.10:35357">http://10.60.60.10:35357</a><br>project_domain_name=Default<br>username=heat<br>user_domain_name=Default<br>password=c9b4b2e3fd704048<br>[volumes]<br>[keystone_authtoken]<br>auth_uri=<a href="http://10.60.60.10:5000/v3">http://10.60.60.10:5000/v3</a><br>auth_type=password<br>auth_url=<a href="http://10.60.60.10:35357">http://10.60.60.10:35357</a><br>username=heat<br>password=c9b4b2e3fd704048<br>user_domain_name=Default<br>project_name=services<br>project_domain_name=Default<br></div><div><div><div><div dir="ltr" class="gmail_signature"><div dir="ltr"><span><div><span style="font-family:arial,helvetica,sans-serif"><span lang="en"><span><br></span></span></span></div><div><span style="font-family:arial,helvetica,sans-serif"><span lang="en"><span>and this is my magnum configuration :</span></span></span></div><div><span style="font-family:arial,helvetica,sans-serif"><span lang="en"><span><br></span></span></span></div><div><span style="font-family:arial,helvetica,sans-serif"><span lang="en"><span>[root@zu-controller0 ~(keystone_admin)]# egrep -v ^'(#|$)' /etc/magnum/magnum.conf <br>[DEFAULT]<br>log_dir=/var/log/magnum<br>transport_url=rabbit://<a href="http://guest:guest@10.60.60.10:5672/">guest:guest@10.60.60.10:5672/</a><br>[cors]<br>[database]<br>connection=mysql+pymysql://<a href="http://magnum:b08c5fe90a0e42e7@10.60.60.10/magnum">magnum:b08c5fe90a0e42e7@10.60.60.10/magnum</a><br>[keystone_authtoken]<br>auth_uri=<a href="http://10.60.60.10:5000/v3">http://10.60.60.10:5000/v3</a><br>auth_version=v3<br>memcached_servers=<a href="http://10.60.60.10:11211">10.60.60.10:11211</a><br>auth_type=password<br>admin_tenant_name=services<br>admin_user=magnum<br>admin_password=f784e0ac913e41e7<br>auth_url=<a href="http://10.60.60.10:35357">http://10.60.60.10:35357</a><br>username=magnum<br>password=f784e0ac913e41e7<br>user_domain_name=Default<br>project_name=services<br>project_domain_name=Default<br>[matchmaker_redis]<br>[oslo_concurrency]<br>[oslo_messaging_amqp]<br>[oslo_messaging_kafka]<br>[oslo_messaging_notifications]<br>driver=messagingv2<br>[oslo_messaging_rabbit]<br>ssl=False<br>[oslo_messaging_zmq]<br>[oslo_policy]<br>policy_file=/etc/magnum/policy.json<br>[trust]<br>trustee_domain_name=magnum<br>trustee_domain_admin_name=magnum_admin<br>trustee_domain_admin_password=f784e0ac913e41e7<br>trustee_keystone_interface=public<br>[api]<br>port=9511<br>host=0.0.0.0<br>max_limit=1000<br>enabled_ssl=False<br>[barbican_client]<br>region_name=RegionOne<br>[cinder_client]<br>region_name=RegionOne<br>[glance_client]<br>region_name=RegionOne<br>api_version=2<br>insecure=False<br>[heat_client]<br>region_name=RegionOne<br>api_version=1<br>insecure=False<br>[magnum_client]<br>region_name=RegionOne<br>[neutron_client]<br>region_name=RegionOne<br>insecure=False<br>[nova_client]<br>region_name=RegionOne<br>api_version=2<br>insecure=False<br>[certificates]<br>cert_manager_type=local<br></span></span></span></div><div><span style="font-family:arial,helvetica,sans-serif"><span lang="en"><span><br></span></span></span></div><div><span style="font-family:arial,helvetica,sans-serif"><span lang="en"><span>Best Regards,<br></span></span></span></div><span lang="en"><span><span style="font-family:arial,helvetica,sans-serif">Zufar Dhiyaulhaq</span></span></span></span></div></div></div><br></div></div></div></div></div></div><br><div class="gmail_quote"><div dir="ltr">On Sun, Dec 16, 2018 at 1:39 AM Zufar Dhiyaulhaq <<a href="mailto:zufar@onf-ambassador.org">zufar@onf-ambassador.org</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div>Hi Ignazio,</div><div><br></div><div>I try to change the heat configuration as you suggested, but still my instance are try to 10.60.60.10.</div><div>this is the output :</div><div><br></div><div>| 0c34c8b0dcdc459f818c2bab04913039 | RegionOne | keystone     | identity        | True    | public    | <a href="http://10.60.60.10:5000/v3" target="_blank">http://10.60.60.10:5000/v3</a>                 |<br>| 8ca42fccdb774f9daf67c95ea61fd006 | RegionOne | keystone     | identity        | True    | admin     | <a href="http://10.60.60.10:35357/v3" target="_blank">http://10.60.60.10:35357/v3</a>                |<br>| 8d0a23730608495980dce151d466a579 | RegionOne | keystone     | identity        | True    | internal  | <a href="http://10.60.60.10:5000/v3" target="_blank">http://10.60.60.10:5000/v3</a>                 |<br></div><div><br></div><div>testing curl :</div><div><br></div><div>@swarm-cluster-wtet5ppc5eqi-primary-master-0 ~]$ curl <a href="http://10.60.60.10:5000/v3" target="_blank">http://10.60.60.10:5000/v3</a><br>^C<br>[fedora@swarm-cluster-wtet5ppc5eqi-primary-master-0 ~]$ curl <a href="http://10.61.61.10:5000/v3" target="_blank">http://10.61.61.10:5000/v3</a><br>{"version": {"status": "stable", "updated": "2018-02-28T00:00:00Z", "media-types": [{"base": "application/json", "type": "application/vnd.openstack.identity-v3+json"}], "id": "v3.10", "links": [{"href": "<a href="http://10.61.61.10:5000/v3/" target="_blank">http://10.61.61.10:5000/v3/</a>", "rel": "self"}]}}[fedora@swarm-cluster-wtet5ppc5eqi-primary-master-0 ~]$<br></div><div><br></div><div><div><div dir="ltr" class="gmail-m_-6447027267962270068gmail_signature"><div dir="ltr"><span><div><span style="font-family:arial,helvetica,sans-serif"><span lang="en"><span><br></span></span></span></div><div><span style="font-family:arial,helvetica,sans-serif"><span lang="en"><span>Best Regards,<br></span></span></span></div><span lang="en"><span><span style="font-family:arial,helvetica,sans-serif">Zufar Dhiyaulhaq</span></span></span></span></div></div></div><br></div></div></div></div><br><div class="gmail_quote"><div dir="ltr">On Sun, Dec 16, 2018 at 1:20 AM Ignazio Cassano <<a href="mailto:ignaziocassano@gmail.com" target="_blank">ignaziocassano@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="auto">What reports the command <div dir="auto">openstack endpoint list | grep keystone</div><div dir="auto"><br></div><div dir="auto">?</div><div dir="auto"><br></div></div><br><div class="gmail_quote"><div dir="ltr">Il giorno Sab 15 Dic 2018 19:16 Zufar Dhiyaulhaq <<a href="mailto:zufar@onf-ambassador.org" target="_blank">zufar@onf-ambassador.org</a>> ha scritto:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div dir="ltr"><div>By Design, my OpenStack have 2 networks.</div><div><br></div><div>External Network (Floating IP) : <a href="http://10.61.61.0/24" rel="noreferrer" target="_blank">10.61.61.0/24</a><br></div><div>Management Network & Data Network (private): <a href="http://10.60.60.0/24" rel="noreferrer" target="_blank">10.60.60.0/24</a></div><div><br></div><div>An instance that deploys with floating IP cant access to the management network. It is possible to change the URL from the error log (10.60.60.10) to 10.61.61.10? </div><div><div><div dir="ltr" class="gmail-m_-6447027267962270068gmail-m_-2045637540384588387m_7790908788062767225gmail_signature"><div dir="ltr"><span><div><span style="font-family:arial,helvetica,sans-serif"><span lang="en"><span><br></span></span></span></div><div><span style="font-family:arial,helvetica,sans-serif"><span lang="en"><span>Best Regards,<br></span></span></span></div><span lang="en"><span><span style="font-family:arial,helvetica,sans-serif">Zufar Dhiyaulhaq</span></span></span></span></div></div></div><br></div></div><br><div class="gmail_quote"><div dir="ltr">On Sun, Dec 16, 2018 at 1:12 AM Zufar Dhiyaulhaq <<a href="mailto:zufar@onf-ambassador.org" rel="noreferrer" target="_blank">zufar@onf-ambassador.org</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div>Yes. Master Node communicates with port 5000, but with a wrong IP address.</div><div><br></div><div>Floating IP give to my instance is in <a href="http://10.61.61.0/24" rel="noreferrer" target="_blank">10.61.61.0/24</a> but all of my endpoints are in <a href="http://10.60.60.0/24" rel="noreferrer" target="_blank">10.60.60.0/24</a>, but when I try to curl manual the endpoint with <a href="http://10.61.61.0/24" rel="noreferrer" target="_blank">10.61.61.0/24</a> it's working fine. <br></div><div>It is possible to change the IP address installed on cloud-init to 10.61.61.X?<br></div><div><div><div dir="ltr" class="gmail-m_-6447027267962270068gmail-m_-2045637540384588387m_7790908788062767225gmail-m_1803969138324256335gmail_signature"><div dir="ltr"><span><div><span style="font-family:arial,helvetica,sans-serif"><span lang="en"><span><br></span></span></span></div><div><span style="font-family:arial,helvetica,sans-serif"><span lang="en"><span>Best Regards,<br></span></span></span></div><span lang="en"><span><span style="font-family:arial,helvetica,sans-serif">Zufar Dhiyaulhaq</span></span></span></span></div></div></div><br></div></div><br><div class="gmail_quote"><div dir="ltr">On Sun, Dec 16, 2018 at 1:08 AM Ignazio Cassano <<a href="mailto:ignaziocassano@gmail.com" rel="noreferrer" target="_blank">ignaziocassano@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="auto"><div dir="auto"></div>Zufar, the master node must communicat with port 5000 on the network where you deployed keystone endpoint.<div dir="auto">Ignazio<br><div class="gmail_quote" dir="auto"><div dir="ltr">Il giorno Sab 15 Dic 2018 18:58 Zufar Dhiyaulhaq <<a href="mailto:zufar@onf-ambassador.org" rel="noreferrer noreferrer" target="_blank">zufar@onf-ambassador.org</a>> ha scritto:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div>Hi I am creating a swarm cluster with this command :<br></div><ul><li>openstack coe cluster template create swarm-cluster-template --image fedora-atomic-latest --external-network external --dns-nameserver 8.8.8.8 --master-flavor m1.small --flavor m1.small --coe swarm-mode --docker-volume-size 4 --docker-storage-driver=devicemapper</li><li>openstack coe cluster create swarm-cluster --cluster-template swarm-cluster-template --master-count 1 --node-count 1 --keypair mykey</li></ul><div>but its stack on <b>swarm_primary_master </b>heat with <b>CREATE_IN_PROGRESS</b>. I try to login into swarm VM and see the log.</div><div><br></div><div>I get this :</div><div><br></div><div><ul><li>requests.exceptions.ConnectionError: HTTPConnectionPool(host='10.60.60.10', port=5000): Max retries exceeded with url: /v3/auth/tokens (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f02f57321d0>: Failed to establish a new connection: [Errno 110] Connection timed out',))</li><li>Cloud-init v. 0.7.9 running 'modules:final' at Sat, 15 Dec 2018 17:36:44 +0000. Up 33.29 seconds.</li></ul><br></div><div>Swarm Instance try to open connection to 10.60.60.10 which is my management ip address on OpenStack.  But it cannot (by design it cannot, I try to curl manual to 10.60.60.10 and error). When curl to 10.61.61.10 which is my floating IP and external IP for OpenStack cluster, it works.</div><div><br></div><div>Anyone know how to change the cloud-init to curl into 10.61.61.10?<br></div><div><div><div dir="ltr" class="gmail-m_-6447027267962270068gmail-m_-2045637540384588387m_7790908788062767225gmail-m_1803969138324256335gmail-m_5792017765612896844m_5489633176588292018m_3928594427421150465gmail_signature"><div dir="ltr"><span><div><span style="font-family:arial,helvetica,sans-serif"><span lang="en"><span><br></span></span></span></div><div><span style="font-family:arial,helvetica,sans-serif"><span lang="en"><span>Best Regards,<br></span></span></span></div><span lang="en"><span><span style="font-family:arial,helvetica,sans-serif">Zufar Dhiyaulhaq</span></span></span></span></div></div></div></div></div></div></div></div></div></div>
</blockquote></div></div></div>
</blockquote></div>
</blockquote></div></div>
</blockquote></div>
</blockquote></div>
</blockquote></div>