<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">
Hi,
<div class=""><br class="">
</div>
<div class="">Still no luck. I have remove the “-“ from the names.</div>
<div class=""><br class="">
</div>
<div class="">
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo; color: rgb(83, 48, 225);" class="">
<b class="">[root@controller: ~/openstack]</b><span style="color: rgb(0, 0, 0);" class=""> # openstack service list </span></div>
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo;" class="">
+----------------------------------+---------------+--------------+</div>
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo;" class="">
| ID | Name | Type |</div>
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo;" class="">
+----------------------------------+---------------+--------------+</div>
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo;" class="">
<font color="#b51a00" class="">| 0f6736013cba469b9ddf21988a071952 | cinderhpc2n | volume |</font></div>
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo;" class="">
| 1fcae9bd76304853a3168c39c7fe8e6b | nova | compute |</div>
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo;" class="">
| 2c7828120c294d3f82e3a17835babb85 | neutron | network |</div>
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo;" class="">
| 3804fcd8f9494d30b589b55fe6abb811 | nova-hpc2n | compute |</div>
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo;" class="">
| 478eff4e96464ae8a958ba29f750b14c | glance | image |</div>
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo;" class="">
<font color="#b51a00" class="">| 61d8baeb4ee74c7798a60758b2f4171f | cinderv2 | volumev2 |</font></div>
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo;" class="">
<font color="#b51a00" class="">| 7bd5d667ec4b4d65b6c1b0de8b303fe3 | cinder | volume |</font></div>
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo;" class="">
| 97f977f8a7a04bae89da167fd25dc06c | glance-hpc2n | image |</div>
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo;" class="">
| dccd39b92ab547ddaf9047b38620145a | swift | object-store |</div>
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo;" class="">
<font color="#b51a00" class="">| dec231e13a114365b6e094421204255f | cinderhpc2nv2 | volumev2 |</font></div>
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo;" class="">
| ebb1660d1d9746759a48de921521bfad | keystone | identity |</div>
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo;" class="">
+----------------------------------+---------------+--------------+</div>
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo; color: rgb(83, 48, 225);" class="">
<b class="">[root@controller: ~/openstack]</b><span style="color: rgb(0, 0, 0);" class=""> # openstack endpoint list</span></div>
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo;" class="">
+----------------------------------+-----------+---------------+--------------+</div>
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo;" class="">
| ID | Region | Service Name | Service Type |</div>
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo;" class="">
+----------------------------------+-----------+---------------+--------------+</div>
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo;" class="">
<font color="#e32400" class="">| 3000cb23c6ab4ee5b68876ee08257338 | regionOne | cinderv2 | volumev2 |</font></div>
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo;" class="">
| e21e935ed861484e976d1b93e0fda0f0 | regionOne | nova | compute |</div>
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo;" class="">
<font color="#e32400" class="">| 42211e6e977d43308a4e288e68b97263 | HPC2N | cinderhpc2nv2 | volumev2 |</font></div>
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo;" class="">
| cdfb008c47a0472ab3a93e6ee07e9ba4 | regionOne | neutron | network |</div>
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo;" class="">
<font color="#e32400" class="">| e2693bcaf3da4be2810f04acd7995d7f | regionOne | cinder | volume |</font></div>
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo;" class="">
| 04acd1666704433d991cf9a75957c815 | HPC2N | glance-hpc2n | image |</div>
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo;" class="">
<font color="#b51a00" class="">| eb1a12119c5c4b2dba78927982121be7 | HPC2N | cinderhpc2n | volume |</font></div>
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo;" class="">
| cfd1c766c56744309767cd84034f9bfb | regionOne | swift | object-store |</div>
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo;" class="">
| abe46f0d86064056927a2177a705787c | HPC2N | nova-hpc2n | compute |</div>
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo;" class="">
| ac522bcd576b4d2b9f5adfb5405730be | regionOne | keystone | identity |</div>
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo;" class="">
| bad524f18fd74ec3b7fb6647ea661686 | regionOne | glance | image |</div>
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo;" class="">
+----------------------------------+-----------+---------------+--------------+</div>
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo;" class="">
<span style="color: rgb(83, 48, 225);" class=""><b class="">[root@controller: ~/openstack]</b></span> # systemctl restart openstack-nova-api.service</div>
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo;" class="">
<br class="">
</div>
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo;" class="">
Even with all the services didn’t help. </div>
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo;" class="">
<br class="">
</div>
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo;" class="">
<span style="color: rgb(83, 48, 225);" class=""><b class="">[root@controller: ~/openstack]</b></span> #<font color="#b51a00" class="">
</font><font color="#e32400" class="">nova volume-attach 800d8ba0-cc17-4877-894a-89adecfb5eb7 85ab8b8a-c75c-45a1-9f51-44ed75ba3210 /dev/vdb</font></div>
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo;" class="">
<font color="#e32400" class="">ERROR (ClientException): The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-f0d9372d-863b-43f6-8281-5c9196a866af)</font></div>
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo;" class="">
<span style="color: rgb(83, 48, 225);" class=""><b class="">[root@controller: ~/openstack]</b></span> #
<font color="#b51a00" class="">openstack service delete cinderhpc2n</font></div>
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo;" class="">
<span style="color: rgb(83, 48, 225);" class=""><b class="">[root@controller: ~/openstack]</b></span> #<font color="#e32400" class=""> openstack service delete cinderhpc2nv2</font></div>
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo; color: rgb(83, 48, 225);" class="">
<b class="">[root@controller: ~/openstack]</b><span style="color: rgb(0, 0, 0);" class=""> # </span></div>
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo; color: rgb(83, 48, 225);" class="">
<b class="">[root@controller: ~/openstack]</b><span style="color: rgb(0, 0, 0);" class=""> # </span></div>
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo; color: rgb(83, 48, 225);" class="">
<b class="">[root@controller: ~/openstack]</b><span style="color: rgb(0, 0, 0);" class=""> # </span></div>
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo; color: rgb(83, 48, 225);" class="">
<b class="">[root@controller: ~/openstack]</b><span style="color: rgb(0, 0, 0);" class=""> # </span></div>
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo;" class="">
<span style="color: rgb(83, 48, 225);" class=""><b class="">[root@controller: ~/openstack]</b></span> #
<font color="#e32400" class="">nova volume-attach 800d8ba0-cc17-4877-894a-89adecfb5eb7 85ab8b8a-c75c-45a1-9f51-44ed75ba3210 /dev/vdb</font></div>
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo;" class="">
+----------+--------------------------------------+</div>
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo;" class="">
| Property | Value |</div>
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo;" class="">
+----------+--------------------------------------+</div>
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo;" class="">
| device | /dev/vdb |</div>
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo;" class="">
| id | 85ab8b8a-c75c-45a1-9f51-44ed75ba3210 |</div>
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo;" class="">
| serverId | 800d8ba0-cc17-4877-894a-89adecfb5eb7 |</div>
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo;" class="">
| volumeId | 85ab8b8a-c75c-45a1-9f51-44ed75ba3210 |</div>
<p style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo;" class="">
</p>
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo;" class="">
+----------+--------------------------------------+</div>
</div>
<div class=""><br class="">
</div>
<div class=""><br class="">
</div>
<div class="">—— nova-api.log ——</div>
<div class=""><span style="font-family: Menlo; font-size: 11px;" class=""><font color="#e32400" class="">2015-12-11 09:43:08.534 16529 TRACE nova.api.openstack EndpointNotFound: internalURL endpoint for volume service named cinder in regionOne region not found</font></span></div>
<div class="">——</div>
<div class=""><br class="">
</div>
<div class="">——nova.conf</div>
<div class="">[cinder]</div>
<div class="">
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo;" class="">
os_region_name = regionOne</div>
</div>
<div class="">——</div>
<div class=""><br class="">
</div>
<div class="">—— cinder.conf</div>
<div class="">[default]</div>
<div class="">
<div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo;" class="">
os_region_name = regionOne</div>
</div>
<div class="">——</div>
<div class=""><br class="">
</div>
<div class="">Regards..</div>
<div class="">Salman. </div>
<div class=""><br class="">
</div>
<div class=""><br class="">
</div>
<div class=""><br class="">
</div>
<div class=""><br class="">
</div>
<div class=""><br class="">
<div apple-content-edited="true" class="">
<div style="color: rgb(0, 0, 0); letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">
<div class="">PhD, Scientific Computing<br class="">
Researcher, IT Department,<br class="">
Uppsala University.</div>
<div class="">
<div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">
Senior Cloud Architect, </div>
<div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">
SNIC.</div>
Cloud Application Expert,<br class="">
UPPMAX.<br class="">
Visiting Researcher,<br class="">
Helsinki Institute of Physics (HIP).<br class="">
<a href="mailto:salman.toor@it.uu.se" class="">salman.toor@it.uu.se</a><br class="">
http://www.it.uu.se/katalog/salto690</div>
</div>
</div>
<br class="">
<div>
<blockquote type="cite" class="">
<div class="">On 10 Dec 2015, at 23:35, Joe Topjian <<a href="mailto:joe@topjian.net" class="">joe@topjian.net</a>> wrote:</div>
<br class="Apple-interchange-newline">
<div class="">
<div dir="ltr" class="">Hi Salman,
<div class=""><br class="">
</div>
<div class="">This has turned into a bit of fun -- I'm seeing a lot of wacky things. </div>
<div class=""><br class="">
</div>
<div class="">First, I'm pretty this issue is local to multi-regions and doesn't have to do with having both Cinder v1 and v2 in the Keystone catalog. I changed my catalog to only have Cinder v2 and I still see multi-region issues. If I had more time, I would
figure out how to forcefully make nova-api use Cinder v1 to confirm it's not a v2 issue, but I'm pretty confident that it is not.</div>
<div class=""><br class="">
</div>
<div class="">Second, strange things happen depending on the UUID of the endpoints. Let's say I create two cinder v2 regions:</div>
<div class=""><br class="">
</div>
<div class="">
<div class="">openstack endpoint create --region RegionOne volumev2 --publicurl <a href="http://10.1.0.112:8776/v2/%/(tenant_id/)s" class="">
http://10.1.0.112:8776/v2/%\(tenant_id\)s</a> --internalurl <a href="http://10.1.0.112:8776/v2/%/(tenant_id/)s" class="">
http://10.1.0.112:8776/v2/%\(tenant_id\)s</a> --adminurl <a href="http://10.1.0.112:8776/v2/%/(tenant_id/)s" class="">
http://10.1.0.112:8776/v2/%\(tenant_id\)s</a><br class="">
</div>
</div>
<div class=""><br class="">
</div>
<div class="">
<div class="">+--------------+-----------------------------------------+</div>
<div class="">| Field | Value |</div>
<div class="">+--------------+-----------------------------------------+</div>
<div class="">| adminurl | <a href="http://10.1.0.112:8776/v2/%(tenant_id)s" class="">
http://10.1.0.112:8776/v2/%(tenant_id)s</a> |</div>
<div class="">| id | a46a5f86b0134944b66c25a7802f7b32 |</div>
<div class="">| internalurl | <a href="http://10.1.0.112:8776/v2/%(tenant_id)s" class="">
http://10.1.0.112:8776/v2/%(tenant_id)s</a> |</div>
<div class="">| publicurl | <a href="http://10.1.0.112:8776/v2/%(tenant_id)s" class="">
http://10.1.0.112:8776/v2/%(tenant_id)s</a> |</div>
<div class="">| region | RegionOne |</div>
<div class="">| service_id | 9cb6eeba4ae5484080ef1a5272b03367 |</div>
<div class="">| service_name | cinderv2 |</div>
<div class="">| service_type | volumev2 |</div>
<div class="">+--------------+-----------------------------------------+</div>
</div>
<div class=""><br class="">
</div>
<div class="">
<div class="">openstack endpoint create --region RegionTwo volumev2 --publicurl <a href="http://10.1.0.113:8776/v2/%/(tenant_id/)s" class="">
http://10.1.0.113:8776/v2/%\(tenant_id\)s</a> --internalurl <a href="http://10.1.0.113:8776/v2/%/(tenant_id/)s" class="">
http://10.1.0.113:8776/v2/%\(tenant_id\)s</a> --adminurl <a href="http://10.1.0.113:8776/v2/%/(tenant_id/)s" class="">
http://10.1.0.113:8776/v2/%\(tenant_id\)s</a></div>
<div class=""><br class="">
</div>
<div class="">
<div class="">
<div class="">+--------------+-----------------------------------------+</div>
<div class="">| Field | Value |</div>
<div class="">+--------------+-----------------------------------------+</div>
<div class="">| adminurl | <a href="http://10.1.0.113:8776/v2/%(tenant_id)s" class="">
http://10.1.0.113:8776/v2/%(tenant_id)s</a> |</div>
<div class="">| id | e9cd7a3fd8734b12a77154d73990261d |</div>
<div class="">| internalurl | <a href="http://10.1.0.113:8776/v2/%(tenant_id)s" class="">
http://10.1.0.113:8776/v2/%(tenant_id)s</a> |</div>
<div class="">| publicurl | <a href="http://10.1.0.113:8776/v2/%(tenant_id)s" class="">
http://10.1.0.113:8776/v2/%(tenant_id)s</a> |</div>
<div class="">| region | RegionTwo |</div>
<div class="">| service_id | 9cb6eeba4ae5484080ef1a5272b03367 |</div>
<div class="">| service_name | cinderv2 |</div>
<div class="">| service_type | volumev2 |</div>
<div class="">+--------------+-----------------------------------------+</div>
</div>
<div class=""><br class="">
</div>
</div>
</div>
<div class="">Note the IDs: RegionOne has a46... and RegionTwo has e9c...</div>
<div class=""><br class="">
</div>
<div class="">When I do "openstack endpoint show cinderv2", RegionTwo will be displayed. Why? Because "e" comes after "a". If I regenerate the endpoints until RegionOne has a UUID that is alphabetically later than RegionTwo, then RegionOne will be displayed.</div>
<div class=""><br class="">
</div>
<div class="">It does not matter what my OS_REGION_NAME environment variable is set to, either.</div>
<div class=""><br class="">
</div>
<div class="">Now, let's say my nova.conf file for the nova-api server in RegionOne does not have the</div>
<div class=""><br class="">
</div>
<div class="">[cinder]</div>
<div class="">os_region_name = RegionOne</div>
<div class=""><br class="">
</div>
<div class="">setting I mentioned earlier (also, note that this needs to go in a "[cinder]" section).</div>
<div class=""><br class="">
</div>
<div class="">If RegionOne's UUID comes earlier in the alphabet (so RegionOne would NOT be displayed in "openstack endpoint show cinderv2"), then "nova volume-attach" works. nova-api will grab the correct endpoint for RegionOne.</div>
<div class=""><br class="">
</div>
<div class="">If RegionOne's UUID comes later in the alphabet, then "nova volume-attach" will try to contact RegionTwo. </div>
<div class=""><br class="">
</div>
<div class="">My guess is that the openstack client is reporting the last returned catalog entry while the nova-api service is using the first returned catalog entry.</div>
<div class=""><br class="">
</div>
<div class="">BUT, if I set </div>
<div class=""><br class="">
</div>
<div class="">
<div class="">[cinder]</div>
<div class="">os_region_name = RegionOne</div>
</div>
<div class=""><br class="">
</div>
<div class="">then "nova volume-attach" works, no matter what order the entries are in the catalog.</div>
<div class=""><br class="">
</div>
<div class=""><br class="">
</div>
<div class="">Given all of the above, here is what is working for me:</div>
<div class=""><br class="">
</div>
<div class="">1. I have two services in my Keystone catalog:</div>
<div class=""><br class="">
</div>
<div class="">cinder: volume</div>
<div class="">cinderv2: volumev2</div>
<div class=""><br class="">
</div>
<div class="">It looks like you have 4:</div>
<div class=""><br class="">
</div>
<div class="">cinder: volume</div>
<div class="">cinderv2: volumev2</div>
<div class=""><span style="font-size:13px" class="">cinder-hpc2n: volume</span><br class="">
</div>
<div class=""><span style="font-size:13px" class="">cinderv2-hpc2n: volumev2</span><span style="font-size:13px" class=""><br class="">
</span></div>
<div class=""><span style="font-size:13px" class=""><br class="">
</span></div>
<div class=""><span style="font-size:13px" class="">I don't know if that makes a difference, but maybe simplify the services to just the standard 2. </span></div>
<div class=""><br class="">
</div>
<div class="">2. nova.conf on the nova-api server has the "os_region_name" setting set to the correct local region. I only had to restart the nova-api service to see changes take effect, but maybe restart nova-* -- who knows at this point!</div>
<div class=""><br class="">
</div>
<div class="">3. Check the spelling of your regions. I noticed that you sometimes have "regionOne" and other times have "RegionOne" but maybe that is just a typo from sanitizing your data.</div>
<div class=""><br class="">
</div>
<div class="">Let me know if this helps :)</div>
<div class=""><br class="">
</div>
<div class="">Joe</div>
</div>
<div class="gmail_extra"><br class="">
<div class="gmail_quote">On Thu, Dec 10, 2015 at 2:31 AM, Salman Toor <span dir="ltr" class="">
<<a href="mailto:salman.toor@it.uu.se" target="_blank" class="">salman.toor@it.uu.se</a>></span> wrote:<br class="">
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div style="word-wrap:break-word" class="">Hi Joe,
<div class=""><br class="">
</div>
<div class="">Thanks for your reply, yes Me and Marco are working together. </div>
<div class=""><br class="">
</div>
<div class="">I have tried to used </div>
<div class=""><br class="">
</div>
<div class="">os_region_name = RegionOne</div>
<div class=""><br class="">
</div>
<div class="">both in cinder.conf and nova.conf but no luck so far. But the error message is a bit different. It seems like now the system is recognising the region. </div>
<div class=""><br class="">
</div>
<div class=""><br class="">
</div>
<div class="">
<p style="font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
<font color="#e32400" class="">2015-12-10 09:32:54.661 26792 TRACE nova.api.openstack EndpointNotFound: internalURL endpoint for volume service named cinder in regionOne region not found</font></p>
<div class=""><br class="">
</div>
</div>
<div class="">Following are my endpoints:</div>
<div class=""><br class="">
</div>
<div class="">——</div>
<div class="">
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
<b class="">[root@controller: ~]</b> # openstack endpoint show cinder</p>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
+--------------+------------------------------------------------+</p>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
| Field | Value |</p>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
+--------------+------------------------------------------------+</p>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
| adminurl | <a href="http://cinder:8776/v1/%(tenant_id)s" style="color:rgb(17,85,204)" target="_blank" class="">http://cinder:8776/v1/%(tenant_id)s</a> |</p>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
| enabled | True |</p>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
| id | e2693bcaf3da4be2810f04acd7995d7f |</p>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
| internalurl | <a href="http://cinder:8776/v1/%(tenant_id)s" style="color:rgb(17,85,204)" target="_blank" class="">http://cinder:8776/v1/%(tenant_id)s</a> |</p>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
| publicurl | <a href="http://smog.uppmax.uu.se:8776/v1/%(tenant_id)s" style="color:rgb(17,85,204)" target="_blank" class="">http://</a><a href="http://cinder:8776/v1/%(tenant_id)s" style="color:rgb(17,85,204)" target="_blank" class="">cinder</a><a href="http://smog.uppmax.uu.se:8776/v1/%(tenant_id)s" style="font-size:12.8px;color:rgb(17,85,204)" target="_blank" class="">:8776/v1/%(tenant_id)s</a><span style="font-size:12.8px" class=""> </span><span style="font-size:12.8px" class="">|</span></p>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
| region | regionOne |</p>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
| service_id | 7bd5d667ec4b4d65b6c1b0de8b303fe3 |</p>
<span class="">
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
| service_name | cinder |</p>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
| service_type | volume |</p>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
+--------------+------------------------------------------------+</p>
</span>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
<b class="">[root@controller: ~]</b> # openstack endpoint show cinderv2</p>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
+--------------+------------------------------------------------+</p>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
| Field | Value |</p>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
+--------------+------------------------------------------------+</p>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
| adminurl | <a href="http://cinder:8776/v2/%(tenant_id)s" style="color:rgb(17,85,204)" target="_blank" class="">http://cinder:8776/v2/%(tenant_id)s</a> |</p>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
| enabled | True |</p>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
| id | 3000cb23c6ab4ee5b68876ee08257338 |</p>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
| internalurl | <a href="http://cinder:8776/v2/%(tenant_id)s" style="color:rgb(17,85,204)" target="_blank" class="">http://cinder:8776/v2/%(tenant_id)s</a> |</p>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
| publicurl | <a href="http://smog.uppmax.uu.se:8776/v2/%(tenant_id)s" style="color:rgb(17,85,204)" target="_blank" class="">http://</a><a href="http://cinder:8776/v1/%(tenant_id)s" style="color:rgb(17,85,204)" target="_blank" class="">cinder</a><a href="http://smog.uppmax.uu.se:8776/v2/%(tenant_id)s" style="font-size:12.8px;color:rgb(17,85,204)" target="_blank" class="">:8776/v2/%(tenant_id)s</a><span style="font-size:12.8px" class=""> </span><span style="font-size:12.8px" class="">|</span></p>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
| region | regionOne |</p>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
| service_id | 61d8baeb4ee74c7798a60758b2f4171f |</p>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
| service_name | cinderv2 |</p>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
| service_type | volumev2 |</p>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
+--------------+------------------------------------------------+</p>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
<b class="">[root@controller: ~]</b> # openstack endpoint show cinder-hpc2n</p>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
+--------------+--------------------------------------------------+</p>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
| Field | Value |</p>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
+--------------+--------------------------------------------------+</p>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
| adminurl | <a href="http://u-mn01.hpc2n.umu.se:8776/v1/%(tenant_id)s" style="color:rgb(17,85,204)" target="_blank" class="">http://</a><a href="http://cinder:8776/v1/%(tenant_id)s" style="color:rgb(17,85,204)" target="_blank" class="">cinder</a><a href="http://u-mn01.hpc2n.umu.se:8776/v1/%(tenant_id)s" style="font-size:12.8px;color:rgb(17,85,204)" target="_blank" class="">:8776/v1/%(tenant_id)s</a><span style="font-size:12.8px" class=""> </span><span style="font-size:12.8px" class="">|</span></p>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
| enabled | True |</p>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
| id | c088f1f9ca0248a08eb60d4ac8492150 |</p>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
| internalurl | <a href="http://u-mn01.hpc2n.umu.se:8776/v1/%(tenant_id)s" style="color:rgb(17,85,204)" target="_blank" class="">http://</a><a href="http://cinder:8776/v1/%(tenant_id)s" style="color:rgb(17,85,204)" target="_blank" class="">cinder</a><a href="http://u-mn01.hpc2n.umu.se:8776/v1/%(tenant_id)s" style="font-size:12.8px;color:rgb(17,85,204)" target="_blank" class="">:8776/v1/%(tenant_id)s</a><span style="font-size:12.8px" class=""> </span><span style="font-size:12.8px" class="">|</span></p>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
| publicurl | <a href="http://u-mn01.hpc2n.umu.se:8776/v1/%(tenant_id)s" style="color:rgb(17,85,204)" target="_blank" class="">http://</a><a href="http://cinder:8776/v1/%(tenant_id)s" style="color:rgb(17,85,204)" target="_blank" class="">cinder</a><a href="http://u-mn01.hpc2n.umu.se:8776/v1/%(tenant_id)s" style="font-size:12.8px;color:rgb(17,85,204)" target="_blank" class="">:8776/v1/%(tenant_id)s</a><span style="font-size:12.8px" class=""> </span><span style="font-size:12.8px" class="">|</span></p>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
| region | HPC2N |</p>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
| service_id | 473f3eab043f4130b30d9ee64fe43703 |</p>
<span class="">
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
| service_name | cinder-hpc2n |</p>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
| service_type | volume |</p>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
+--------------+--------------------------------------------------+</p>
</span>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
<b class="">[root@controller: ~]</b> # openstack endpoint show cinderv2-hpc2n</p>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
+--------------+--------------------------------------------------+</p>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
| Field | Value |</p>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
+--------------+--------------------------------------------------+</p>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
| adminurl | <a href="http://u-mn01.hpc2n.umu.se:8776/v2/%(tenant_id)s" style="color:rgb(17,85,204)" target="_blank" class="">http://</a><a href="http://cinder:8776/v1/%(tenant_id)s" style="color:rgb(17,85,204)" target="_blank" class="">cinder</a><a href="http://u-mn01.hpc2n.umu.se:8776/v2/%(tenant_id)s" style="font-size:12.8px;color:rgb(17,85,204)" target="_blank" class="">:8776/v2/%(tenant_id)s</a><span style="font-size:12.8px" class=""> </span><span style="font-size:12.8px" class="">|</span></p>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
| enabled | True |</p>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
| id | 985e5b8b068e4c3d99c12788236ee0fe |</p>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
| internalurl | <a href="http://u-mn01.hpc2n.umu.se:8776/v2/%(tenant_id)s" style="color:rgb(17,85,204)" target="_blank" class="">http://</a><a href="http://cinder:8776/v1/%(tenant_id)s" style="color:rgb(17,85,204)" target="_blank" class="">cinder</a><a href="http://u-mn01.hpc2n.umu.se:8776/v2/%(tenant_id)s" style="font-size:12.8px;color:rgb(17,85,204)" target="_blank" class="">:8776/v2/%(tenant_id)s</a><span style="font-size:12.8px" class=""> </span><span style="font-size:12.8px" class="">|</span></p>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
| publicurl | <a href="http://u-mn01.hpc2n.umu.se:8776/v2/%(tenant_id)s" style="color:rgb(17,85,204)" target="_blank" class="">http://</a><a href="http://cinder:8776/v1/%(tenant_id)s" style="color:rgb(17,85,204)" target="_blank" class="">cinder</a><a href="http://u-mn01.hpc2n.umu.se:8776/v2/%(tenant_id)s" style="font-size:12.8px;color:rgb(17,85,204)" target="_blank" class="">:8776/v2/%(tenant_id)s</a><span style="font-size:12.8px" class=""> </span><span style="font-size:12.8px" class="">|</span></p>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
| region | HPC2N |</p>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
| service_id | 089186fad4d7444b95e74ea9d7769423 |</p>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
| service_name | cinderv2-hpc2n |</p>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
| service_type | volumev2 |</p>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
<br class="">
</p>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;background-color:rgb(255,255,255)" class="">
+--------------+--------------------------------------------------+</p>
</div>
<div class="">——</div>
<div class=""><br class="">
</div>
<div class="">Again if I remove hpc2n everything started to work fine. Can you tell me what service I suppose to restart (if required)?</div>
<div class=""><br class="">
</div>
<div class="">Regards..</div>
<span class="HOEnZb"><font color="#888888" class="">
<div class="">Salman</div>
<div class=""><br class="">
</div>
<div class=""><br class="">
</div>
</font></span>
<div class=""><span class=""><br class="">
<div class="">
<div style="letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; word-wrap: break-word;" class="">
PhD, Scientific Computing<br class="">
Researcher, IT Department,<br class="">
Uppsala University.<br class="">
Senior Cloud Architect, <br class="">
SNIC.<br class="">
Cloud Application Expert,<br class="">
UPPMAX.<br class="">
Visiting Researcher,<br class="">
Helsinki Institute of Physics (HIP).<br class="">
<a href="mailto:salman.toor@it.uu.se" target="_blank" class="">salman.toor@it.uu.se</a><br class="">
<a href="http://www.it.uu.se/katalog/salto690" target="_blank" class="">http://www.it.uu.se/katalog/salto690</a></div>
</div>
<br class="">
</span>
<div class="">
<div class="h5">
<div class="">
<blockquote type="cite" class="">
<div class="">On 09 Dec 2015, at 17:48, Joe Topjian <<a href="mailto:joe@topjian.net" target="_blank" class="">joe@topjian.net</a>> wrote:</div>
<br class="">
<div class="">
<div dir="ltr" class="">Hi Salman,
<div class=""><br class="">
</div>
<div class="">Someone mentioned this same issue yesterday in relation to Terraform (maybe a colleague of yours?), so given the two occurrences, I thought I'd look into this.</div>
<div class=""><br class="">
</div>
<div class="">I have a Liberty environment readily available, so I created a second set of volume and volumev2 endpoints for a fictional region. Everything worked as expected, so I started reviewing the config files and saw that /etc/cinder/cinder.conf had
an option</div>
<div class=""><br class="">
</div>
<div class="">[DEFAULT]</div>
<div class="">os_region_name = RegionOne</div>
<div class=""><br class="">
</div>
<div class="">I commented that out, but things still worked.</div>
<div class=""><br class="">
</div>
<div class="">Then in /etc/nova/nova.conf, I saw:</div>
<div class=""><br class="">
</div>
<div class="">[cinder]</div>
<div class="">os_region_name = RegionOne</div>
<div class=""><br class="">
</div>
<div class="">commenting this out caused volume attachments to hang indefinitely because nova was trying to contact cinder at RegionTwo (I'm assuming this is the first catalog entry that was returned).</div>
<div class=""><br class="">
</div>
<div class="">Given this is a Liberty environment, it's not accurately reproducing your problem, but could you check and see if you have that option set in nova.conf?</div>
<div class=""><br class="">
</div>
<div class="">I have a Kilo environment in the process of building. Once it has finished, I'll see if I can reproduce your error there.</div>
<div class=""><br class="">
</div>
<div class="">Thanks,</div>
<div class="">Joe</div>
</div>
<div class="gmail_extra"><br class="">
<div class="gmail_quote">On Wed, Dec 9, 2015 at 4:35 AM, Salman Toor <span dir="ltr" class="">
<<a href="mailto:salman.toor@it.uu.se" target="_blank" class="">salman.toor@it.uu.se</a>></span> wrote:<br class="">
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div style="word-wrap:break-word" class="">
<div class="">Hi, </div>
<div class=""><br class="">
</div>
<div class="">I am using Kilo release on CentOS. We have recently enabled multiple regions and it seems that Cinder have some problems with multiple endpoints. </div>
<div class=""><br class="">
</div>
<div class="">Thinks are working fine with nova but cinder is behaving strange. Here are my endpoints </div>
<div class=""><br class="">
</div>
<div class=""><br class="">
</div>
<div class="">————</div>
<div class="">
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
<div style="margin:0px;line-height:normal" class=""><span style="color:#5330e1" class=""><b class="">[root@controller: ~]</b></span> # openstack service list</div>
<div style="margin:0px;line-height:normal" class="">+----------------------------------+----------------+--------------+</div>
<div style="margin:0px;line-height:normal" class="">| ID | Name | Type |</div>
<div style="margin:0px;line-height:normal" class="">+----------------------------------+----------------+--------------+</div>
<div style="margin:0px;line-height:normal" class=""><font color="#e32400" class="">| 0a33e6f259794ff2a99e626be37c0c2b | cinderv2-hpc2n | volumev2 |</font></div>
<div style="margin:0px;line-height:normal" class="">| 1fcae9bd76304853a3168c39c7fe8e6b | nova | compute |</div>
<div style="margin:0px;line-height:normal" class="">| 2c7828120c294d3f82e3a17835babb85 | neutron | network |</div>
<div style="margin:0px;line-height:normal" class="">| 3804fcd8f9494d30b589b55fe6abb811 | nova-hpc2n | compute |</div>
<div style="margin:0px;line-height:normal" class="">| 478eff4e96464ae8a958ba29f750b14c | glance | image |</div>
<div style="margin:0px;line-height:normal" class=""><font color="#e32400" class="">| 4a5a771d915e43c28e66538b8bc6e625 | cinder | volume |</font></div>
<div style="margin:0px;line-height:normal" class=""><font color="#e32400" class="">| 72d1be82b2e5478dbf0f3fb9e7ba969d | cinderv2 | volumev2 |</font></div>
<div style="margin:0px;line-height:normal" class="">| 97f977f8a7a04bae89da167fd25dc06c | glance-hpc2n | image |</div>
<div style="margin:0px;line-height:normal" class=""><font color="#e32400" class="">| a985795b49e2440db82970b81248c86e | cinder-hpc2n | volume |</font></div>
<div style="margin:0px;line-height:normal" class="">| dccd39b92ab547ddaf9047b38620145a | swift | object-store |</div>
<div style="margin:0px;line-height:normal" class="">| ebb1660d1d9746759a48de921521bfad | keystone | identity |</div>
<div style="margin:0px;line-height:normal" class="">+----------------------------------+----------------+--------------+</div>
</div>
</div>
<div class=""><br class="">
</div>
<div class="">
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
<span style="color:#5330e1" class=""><b class="">[root@controller: ~]</b></span> # openstack endpoint show a985795b49e2440db82970b81248c86e</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
+--------------+--------------------------------------------------+</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
| Field | Value |</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
+--------------+--------------------------------------------------+</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
| adminurl | http://<URL>:8776/v1/%(tenant_id)s |</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
| enabled | True |</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
| id | d4003e91ddf24cfb9fa497da81b01a18 |</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
| internalurl | http://<URL>:8776/v1/%(tenant_id)s |</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
| publicurl | http://<URL>:8776/v1/%(tenant_id)s |</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
| region | HPC2N |</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
| service_id | a985795b49e2440db82970b81248c86e |</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
| service_name | cinder-hpc2n |</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
| service_type | volume |</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
+--------------+--------------------------------------------------+</div>
</div>
<div class=""><br class="">
</div>
<div class="">
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
<span style="color:#5330e1" class=""><b class="">[root@controller: ~]</b></span> # openstack endpoint show 4a5a771d915e43c28e66538b8bc6e625</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
+--------------+------------------------------------------------+</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
| Field | Value |</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
+--------------+------------------------------------------------+</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
| adminurl | http://<URL>:8776/v1/%(tenant_id)s |</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
| enabled | True |</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
| id | 5f19c0b535674dbd9e318c7b6d61b3bc |</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
| internalurl | http://<URL>:8776/v1/%(tenant_id)s |</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
| publicurl | http://<URL>:8776/v1/%(tenant_id)s |</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
| region | regionOne |</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
| service_id | 4a5a771d915e43c28e66538b8bc6e625 |</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
| service_name | cinder |</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
| service_type | volume |</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
+--------------+------------------------------------------------+</div>
</div>
<div class=""><br class="">
</div>
<div class="">And same for v2 endpoints </div>
<div class=""><br class="">
</div>
<div class="">————</div>
<div class=""><br class="">
</div>
<div class="">——— nova-api.log ———</div>
<div class=""><br class="">
</div>
<div class="">
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
achmentController object at 0x598a3d0>>, body: {"volumeAttachment": {"device": "", "volumeId": "93d96eab-e3fd-4131-9549-ed51e7299da2"}} _process_stack /usr/lib/python2.7/site-packages/nova/api/openstack/wsgi.py:780</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.847 3376 INFO nova.api.openstack.compute.contrib.volumes [req-d6e1380d-c6bc-4911-b2c6-251bc8b4c62c a62c20fdf99c443a924f0d50a51514b1 3c9d997982e04c6db0e02b82fa18fdd8 - - -] Attach volume 93d96eab-e3fd-4131-9549-ed51e7299da2 to instance 3a4c8722-52a7-48f2-beb7-db8938698a0d
at </div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.847 3376 DEBUG nova.compute.api [req-d6e1380d-c6bc-4911-b2c6-251bc8b4c62c a62c20fdf99c443a924f0d50a51514b1 3c9d997982e04c6db0e02b82fa18fdd8 - - -] [instance: 3a4c8722-52a7-48f2-beb7-db8938698a0d] Fetching instance by UUID get /usr/lib/python2.7/site-packages/nova/compute/api.py:1911</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 ERROR nova.api.openstack [req-d6e1380d-c6bc-4911-b2c6-251bc8b4c62c a62c20fdf99c443a924f0d50a51514b1 3c9d997982e04c6db0e02b82fa18fdd8 - - -] Caught error: internalURL endpoint for volume service named cinder not found</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack Traceback (most recent call last):</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack File "/usr/lib/python2.7/site-packages/nova/api/openstack/__init__.py", line 125, in __call__</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack return req.get_response(self.application)</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack File "/usr/lib/python2.7/site-packages/webob/request.py", line 1296, in send</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack application, catch_exc_info=False)</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack File "/usr/lib/python2.7/site-packages/webob/request.py", line 1260, in call_application</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack app_iter = application(self.environ, start_response)</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack File "/usr/lib/python2.7/site-packages/webob/dec.py", line 144, in __call__</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack return resp(environ, start_response)</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack File "/usr/lib/python2.7/site-packages/keystonemiddleware/auth_token/__init__.py", line 634, in __call__</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack return self._call_app(env, start_response)</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack File "/usr/lib/python2.7/site-packages/keystonemiddleware/auth_token/__init__.py", line 554, in _call_app</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack return self._app(env, _fake_start_response)</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack File "/usr/lib/python2.7/site-packages/webob/dec.py", line 144, in __call__</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack return resp(environ, start_response)</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack File "/usr/lib/python2.7/site-packages/webob/dec.py", line 144, in __call__</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack return resp(environ, start_response)</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack File "/usr/lib/python2.7/site-packages/routes/middleware.py", line 131, in __call__</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack response = self.app(environ, start_response)</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack File "/usr/lib/python2.7/site-packages/webob/dec.py", line 144, in __call__</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack return resp(environ, start_response)</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack File "/usr/lib/python2.7/site-packages/webob/dec.py", line 130, in __call__</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack resp = self.call_func(req, *args, **self.kwargs)</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack File "/usr/lib/python2.7/site-packages/webob/dec.py", line 195, in call_func</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack return self.func(req, *args, **kwargs)</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack File "/usr/lib/python2.7/site-packages/nova/api/openstack/wsgi.py", line 756, in __call__</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack content_type, body, accept)</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack File "/usr/lib/python2.7/site-packages/nova/api/openstack/wsgi.py", line 821, in _process_stack</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack action_result = self.dispatch(meth, request, action_args)</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack File "/usr/lib/python2.7/site-packages/nova/api/openstack/wsgi.py", line 911, in dispatch</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack return method(req=request, **action_args)</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack File "/usr/lib/python2.7/site-packages/nova/api/openstack/compute/contrib/volumes.py", line 305, in create</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack volume_id, device)</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 230, in wrapped</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack return func(self, context, target, *args, **kwargs)</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 219, in inner</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack return function(self, context, instance, *args, **kwargs)</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 200, in inner</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack return f(self, context, instance, *args, **kw)</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 3035, in attach_volume</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack disk_bus, device_type)</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 3016, in _attach_volume</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack volume_bdm.destroy()</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 85, in __exit__</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack six.reraise(self.type_, self.value, self.tb)</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 3009, in _attach_volume</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack volume = self.volume_api.get(context, volume_id)</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack File "/usr/lib/python2.7/site-packages/nova/volume/cinder.py", line 214, in wrapper</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack res = method(self, ctx, volume_id, *args, **kwargs)</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack File "/usr/lib/python2.7/site-packages/nova/volume/cinder.py", line 286, in get</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack item = cinderclient(context).volumes.get(volume_id)</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack File "/usr/lib/python2.7/site-packages/nova/volume/cinder.py", line 115, in cinderclient</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack url = _SESSION.get_endpoint(auth, **service_parameters)</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack File "/usr/lib/python2.7/site-packages/keystoneclient/session.py", line 635, in get_endpoint</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack return auth.get_endpoint(self, **kwargs)</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack File "/usr/lib/python2.7/site-packages/keystoneclient/auth/identity/base.py", line 219, in get_endpoint</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack service_name=service_name)</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack File "/usr/lib/python2.7/site-packages/keystoneclient/utils.py", line 318, in inner</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack return func(*args, **kwargs)</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack File "/usr/lib/python2.7/site-packages/keystoneclient/service_catalog.py", line 254, in url_for</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack raise exceptions.EndpointNotFound(msg)</div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
<font color="#ff4013" class="">2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack EndpointNotFound: internalURL endpoint for volume service named cinder not found</font></div>
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
2015-12-08 12:52:05.988 3376 TRACE nova.api.openstack</div>
</div>
<div class=""><br class="">
</div>
<div class="">———</div>
<div class=""><br class="">
</div>
<div class="">If I remove cinder-hpc2n and cinderv2-hpc2n from the service list, everything started to work fine. </div>
<div class=""><br class="">
</div>
<div class="">This is how I have created endpoints: </div>
<div class=""><br class="">
</div>
<div class=""><br class="">
</div>
<div class="">
<div style="margin:0px;font-size:11px;line-height:normal;font-family:Menlo" class="">
openstack endpoint create --publicurl http://<URL>:8776/v1/%\(tenant_id\)s --internalurl http://<URL>:8776/v1/%\(tenant_id\)s --adminurl http://<URL>:8776/v1/%\(tenant_id\)s --region regionOne 4a5a771d915e43c28e66538b8bc6e625 </div>
</div>
<div class=""><br class="">
</div>
<div class=""><span style="font-family:Menlo;font-size:11px" class="">openstack endpoint create --publicurl http://<URL>:8776/v1/%\(tenant_id\)s --internalurl http://<URL>:8776/v1/%\(tenant_id\)s --adminurl http://<URL>:8776/v1/%\(tenant_id\)s --region HPC2N </span><span style="font-family:Menlo;font-size:11px" class="">a985795b49e2440db82970b81248c86e</span></div>
<div class=""><br class="">
</div>
<div class="">using the service-id. </div>
<div class=""><br class="">
</div>
<div class=""><br class="">
</div>
<div class="">Anyone experiencing this behavior? or Any suggestion how to fix it? Again regions are working fine with nova and glance. </div>
<div class=""><br class="">
</div>
<div class=""><br class="">
</div>
<div class="">Regards..</div>
<div class="">Salman. </div>
<div class=""><br class="">
</div>
<div class=""><br class="">
</div>
<div class="">
<div style="letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;word-wrap:break-word" class="">
<div class="">PhD, Scientific Computing<br class="">
Researcher, IT Department,<br class="">
Uppsala University.</div>
<div class="">
<div style="word-wrap:break-word" class="">Senior Cloud Architect, </div>
<div style="word-wrap:break-word" class="">SNIC.</div>
Cloud Application Expert,<br class="">
UPPMAX.<br class="">
Visiting Researcher,<br class="">
Helsinki Institute of Physics (HIP).<br class="">
<a href="mailto:salman.toor@it.uu.se" target="_blank" class="">salman.toor@it.uu.se</a><br class="">
<a href="http://www.it.uu.se/katalog/salto690" target="_blank" class="">http://www.it.uu.se/katalog/salto690</a></div>
</div>
</div>
<br class="">
</div>
<br class="">
_______________________________________________<br class="">
OpenStack-operators mailing list<br class="">
<a href="mailto:OpenStack-operators@lists.openstack.org" target="_blank" class="">OpenStack-operators@lists.openstack.org</a><br class="">
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators" rel="noreferrer" target="_blank" class="">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators</a><br class="">
<br class="">
</blockquote>
</div>
<br class="">
</div>
</div>
</blockquote>
</div>
<br class="">
</div>
</div>
</div>
</div>
</blockquote>
</div>
<br class="">
</div>
</div>
</blockquote>
</div>
<br class="">
</div>
</body>
</html>