[Openstack] [openstack][cinder] cinder create gives an error

Ahmed Al-Mehdi ahmed at coraid.com
Thu Nov 8 22:55:00 UTC 2012


Hi Darren,

I figured out the issue.  I ran into the following bug - https://bugs.launchpad.net/devstack/+bug/1072121.

Basically, the issue was an entry in the /etc/tgt/targets.conf file, which was causing "tgt-adm —update …" command to fail.

Thank you,
Ahmed.


From: Darren Birkett <darren.birkett at gmail.com<mailto:darren.birkett at gmail.com>>
Reply-To: "darren.birkett at gmail.com<mailto:darren.birkett at gmail.com>" <darren.birkett at gmail.com<mailto:darren.birkett at gmail.com>>
Date: Thursday, November 8, 2012 7:19 AM
To: Ahmed Al-Mehdi <ahmed at coraid.com<mailto:ahmed at coraid.com>>
Cc: John Griffith <john.griffith at solidfire.com<mailto:john.griffith at solidfire.com>>, "openstack at lists.launchpad.net<mailto:openstack at lists.launchpad.net>" <openstack at lists.launchpad.net<mailto:openstack at lists.launchpad.net>>
Subject: Re: [Openstack] [openstack][cinder] cinder create gives an error

Ahmed,

What errors can you see in cinder-volume.log when the volume creation fails?

The guide you refer to talks about creating a VG from a local file for testing purposes only.  In a production setup you would create a VG using real disks/partitions.  For cinder, the default vg name expected is cinder-volumes (this can be changed in cinder.conf).  For nova-volume it was nova-volumes.

Thanks
Darren


On 7 November 2012 15:29, Ahmed Al-Mehdi <ahmed at coraid.com<mailto:ahmed at coraid.com>> wrote:
John,

I verified step 13 in the Migrate twiki.  Just curious, should I create the VG in a certain directory (e.g  /var/lib/cinder/volumes).

Also, In the document "Openstack Deploy and Install manual", the steps for nova-volume recommend having a VG group called nova-volumes (created from a partition).  However, the steps mentioned in ( http://docs.openstack.org/trunk/openstack-compute/install/apt/content/osfolubuntu-cinder.html ) creates a VG from a local file.   Will be the recommend way to setup cinder service going forward.  Just making sure I am not missing anything.

root at bodega:/etc/cinder# date; cinder --debug  create   --display_name test 1
Wed Nov  7 07:06:20 PST 2012
connect: (10.176.20.158, 5000)
send: 'POST /v2.0/tokens HTTP/1.1\r\nHost: 10.176.20.158:5000<http://10.176.20.158:5000>\r\nContent-Length: 108\r\ncontent-type: application/json\r\naccept-encoding: gzip, deflate\r\naccept
: application/json\r\nuser-agent: pyth
on-cinderclient\r\n\r\n{"auth": {"tenantName": "openstackDemo", "passwordCredentials": {"username": "admin", "password": "admin"}}}'
reply: 'HTTP/1.1 200 OK\r\n'
header: Vary: X-Auth-Token
header: Content-Type: application/json
header: Date: Wed, 07 Nov 2012 15:06:21 GMT
header: Transfer-Encoding: chunked
connect: (10.176.20.158, 8776)
send: u'POST /v1/ce1e819636744dc680fa5515f6475e87/volumes HTTP/1.1\r\nHost: 10.176.20.158:8776<http://10.176.20.158:8776>\r\nContent-Length: 267\r\nx-auth-project-id: openstackDemo\r\naccep
t-encoding: gzip, deflate\r\naccept: a
pplication/json\r\nx-auth-token: 6cd16b521733442bb3b1dda1dd4e07fa\r\nuser-agent: python-cinderclient\r\ncontent-type: application/json\r\n\r\n{"volume": {"status": "creating", "availability_zone": nul
l, "display_description": null, "snapshot_id": null, "user_id": null, "size": 1, "display_name": "test", "imageRef": null, "attach_status": "detached", "volume_type": null, "project_id": null, "metada
ta": {}}}'
reply: 'HTTP/1.1 200 OK\r\n'
header: X-Compute-Request-Id: req-a197827f-f1fd-4bc8-86a1-93f14e6cdb4f
header: Content-Type: application/json
header: Content-Length: 296
header: Date: Wed, 07 Nov 2012 15:06:21 GMT
+---------------------+--------------------------------------+
|       Property      |                Value                 |
+---------------------+--------------------------------------+
|     attachments     |                  []                  |
|  availability_zone  |                 nova                 |
|      created_at     |      2012-11-07T15:06:21.369097      |
| display_description |                 None                 |
|     display_name    |                 test                 |
|          id         | f8ee648c-455b-4f54-bb9e-8eafbdc33add |
|       metadata      |                  {}                  |
|         size        |                  1                   |
|     snapshot_id     |                 None                 |
|        status       |               creating               |
|     volume_type     |                 None                 |
+---------------------+--------------------------------------+
root at bodega:/etc/cinder#
root at bodega:/etc/cinder#
root at bodega:/etc/cinder# date; cinder --debug  list
Wed Nov  7 07:06:47 PST 2012
connect: (10.176.20.158, 5000)
send: 'POST /v2.0/tokens HTTP/1.1\r\nHost: 10.176.20.158:5000<http://10.176.20.158:5000>\r\nContent-Length: 108\r\ncontent-type: application/json\r\naccept-encoding: gzip, deflate\r\naccept: application/json\r\nuser-agent: pyth
on-cinderclient\r\n\r\n{"auth": {"tenantName": "openstackDemo", "passwordCredentials": {"username": "admin", "password": "admin"}}}'
reply: 'HTTP/1.1 200 OK\r\n'
header: Vary: X-Auth-Token
header: Content-Type: application/json
header: Date: Wed, 07 Nov 2012 15:06:47 GMT
header: Transfer-Encoding: chunked
connect: (10.176.20.158, 8776)
send: u'GET /v1/ce1e819636744dc680fa5515f6475e87/volumes/detail HTTP/1.1\r\nHost: 10.176.20.158:8776<http://10.176.20.158:8776>\r\nx-auth-project-id: openstackDemo\r\nx-auth-token: 696766788b9e449e8058dea454f12298\r\naccept-enc
oding: gzip, deflate\r\naccept: application/json\r\nuser-agent: python-cinderclient\r\n\r\n'
reply: 'HTTP/1.1 200 OK\r\n'
header: X-Compute-Request-Id: req-c89c9562-5237-4d33-bcbc-e756e763ca3a
header: Content-Type: application/json
header: Content-Length: 296
header: Date: Wed, 07 Nov 2012 15:06:47 GMT
+--------------------------------------+--------+--------------+------+-------------+-------------+
|                  ID                  | Status | Display Name | Size | Volume Type | Attached to |
+--------------------------------------+--------+--------------+------+-------------+-------------+
| f8ee648c-455b-4f54-bb9e-8eafbdc33add | error  |     test     |  1   |     None    |             |
+--------------------------------------+--------+--------------+------+-------------+-------------+
root at bodega:/etc/cinder#

Thank you,
Ahmed.


Regards,
Ahmed.

From: John Griffith <john.griffith at solidfire.com<mailto:john.griffith at solidfire.com>>
Date: Tuesday, November 6, 2012 3:53 PM

To: Ahmed Al-Mehdi <ahmed at coraid.com<mailto:ahmed at coraid.com>>
Cc: "openstack at lists.launchpad.net<mailto:openstack at lists.launchpad.net>" <openstack at lists.launchpad.net<mailto:openstack at lists.launchpad.net>>
Subject: Re: [Openstack] [openstack][cinder] cinder create gives an error



On Tue, Nov 6, 2012 at 3:44 PM, Ahmed Al-Mehdi <ahmed at coraid.com<mailto:ahmed at coraid.com>> wrote:
John,

I reboot my controller node, and things seem to be working a bit better.   I followed the steps in "OpenStack Deploy and Install – Ubuntu", section Appendix B ( http://docs.openstack.org/trunk/openstack-compute/install/apt/content/osfolubuntu-cinder.html ).  All the three cinder-api/volume/scheduler services are running.

root at bodega:/var/log/cinder# ps aux | grep cinder
cinder    1329  0.0  0.0  37952  1312 ?        Ss   12:01   0:00 su -s /bin/sh -c exec cinder-scheduler --config-file=/etc/cinder/cinder.conf --log-file=/var/log/cinder/cinder-scheduler.log cinder
cinder    1331  0.0  0.4 182508 34424 ?        S    12:01   0:07 /usr/bin/python /usr/bin/cinder-scheduler --config-file=/etc/cinder/cinder.conf --log-file=/var/log/cinder/cinder-scheduler.log
cinder    2289  0.0  0.0  37952  1308 ?        Ss   12:08   0:00 su -s /bin/sh -c exec cinder-api --config-file=/etc/cinder/cinder.conf --log-file=/var/log/cinder/cinder-api.log cinder
cinder    2290  0.0  0.5 213864 46872 ?        S    12:08   0:01 /usr/bin/python /usr/bin/cinder-api --config-file=/etc/cinder/cinder.conf --log-file=/var/log/cinder/cinder-api.log
cinder    2537  0.0  0.0  37952  1312 ?        Ss   12:22   0:00 su -s /bin/sh -c exec cinder-volume --config-file=/etc/cinder/cinder.conf --log-file=/var/log/cinder/cinder-volume.log cinder
cinder    2538  0.0  0.4 184644 36812 ?        S    12:22   0:06 /usr/bin/python /usr/bin/cinder-volume --config-file=/etc/cinder/cinder.conf --log-file=/var/log/cinder/cinder-volume.log

VG "cinder-volumes" is present:

root at bodega:/var/log/cinder# vgdisplay  cinder-volumes
  --- Volume group ---
  VG Name               cinder-volumes
  System ID
  Format                lvm2
  Metadata Areas        1
  Metadata Sequence No  6
  VG Access             read/write
  VG Status             resizable
  MAX LV                0
  Cur LV                1
  Open LV               0
  Max PV                0
  Cur PV                1
  Act PV                1
  VG Size               2.00 GiB
  PE Size               4.00 MiB
  Total PE              511
  Alloc PE / Size       256 / 1.00 GiB
  Free  PE / Size       255 / 1020.00 MiB
  VG UUID               VhxQZx-fB8K-36V9-L0sB-ImVO-oVFw-LNOLM0


However, when I create a 1GB test volume (as per the instructions), I run into a failure.

root at bodega:~/ahmed/cinder# date; cinder create --display_name test 1
Tue Nov  6 12:57:39 PST 2012
+---------------------+--------------------------------------+
|       Property      |                Value                 |
+---------------------+--------------------------------------+
|     attachments     |                  []                  |
|  availability_zone  |                 nova                 |
|      created_at     |      2012-11-06T20:57:39.538245      |
| display_description |                 None                 |
|     display_name    |                 test                 |
|          id         | ab719d8d-42a4-44bc-b627-96b30e3f5002 |
|       metadata      |                  {}                  |
|         size        |                  1                   |
|     snapshot_id     |                 None                 |
|        status       |               creating               |
|     volume_type     |                 None                 |
+---------------------+--------------------------------------+
root at bodega:~/ahmed/cinder#
root at bodega:~/ahmed/cinder#
root at bodega:~/ahmed/cinder#
root at bodega:~/ahmed/cinder# date; cinder list
Tue Nov  6 13:06:46 PST 2012
+--------------------------------------+--------+--------------+------+-------------+-------------+
|                  ID                  | Status | Display Name | Size | Volume Type | Attached to |
+--------------------------------------+--------+--------------+------+-------------+-------------+
| ab719d8d-42a4-44bc-b627-96b30e3f5002 | error  |     test     |  1   |     None    |             |
+--------------------------------------+--------+--------------+------+-------------+-------------+
root at bodega:~/ahmed/cinder#

I am attaching text file containing the log entries from the three cinder log files.   Can you please help me understand why the volume creation is failing?  I really appreciate your help.

Regards,
Ahmed.


From: John Griffith <john.griffith at solidfire.com<mailto:john.griffith at solidfire.com>>
Date: Tuesday, November 6, 2012 11:41 AM

To: Ahmed Al-Mehdi <ahmed at coraid.com<mailto:ahmed at coraid.com>>
Cc: "openstack at lists.launchpad.net<mailto:openstack at lists.launchpad.net>" <openstack at lists.launchpad.net<mailto:openstack at lists.launchpad.net>>
Subject: Re: [Openstack] [openstack][cinder] cinder create gives an error



On Tue, Nov 6, 2012 at 11:28 AM, Ahmed Al-Mehdi <ahmed at coraid.com<mailto:ahmed at coraid.com>> wrote:
John,

Thank you for your response.  When you stay start from scratch, do you mean re-install everything (all services) from scratch, as in a fresh install of Ubuntu?   And then not install nova-volume and don't create endpoint for nova-volume?

Not to impose on you, but can you help me understand what does the following error mean:
    ERROR: Malformed request url (HTTP 400) (Request-ID: req-8cff9608-598b-4618-bdc1-1068a1227781)

Is there an issue with how the REST command (Get/Put) is formed?
Is the service not listening on the expected port, or the service is not even up and running?

Regards,
Ahmed.


From: John Griffith <john.griffith at solidfire.com<mailto:john.griffith at solidfire.com>>
Date: Tuesday, November 6, 2012 11:19 AM
To: Ahmed Al-Mehdi <ahmed at coraid.com<mailto:ahmed at coraid.com>>
Cc: "openstack at lists.launchpad.net<mailto:openstack at lists.launchpad.net>" <openstack at lists.launchpad.net<mailto:openstack at lists.launchpad.net>>
Subject: Re: [Openstack] [openstack][cinder] cinder create gives an error



On Tue, Nov 6, 2012 at 11:10 AM, Ahmed Al-Mehdi <ahmed at coraid.com<mailto:ahmed at coraid.com>> wrote:
Hello,

I just installed installed cinder, however, I am getting the following error.

root at bodega:~/ahmed/cinder# cinder create --display_name test 1
ERROR: Malformed request url (HTTP 400) (Request-ID: req-a488154b-37f8-47e8-ae5f-8e7a73f6637b)
root at bodega:~/ahmed/cinder#


Can someone please help me understand what this error means.  I don't see any logs being generated in any of the cinder log files - cinder–api.log, cinder-scheduler.log, cinder-volume.log.

Any pointers to debug this issue would be greatly appreciated.

Regards,
Ahmed.


_______________________________________________
Mailing list: https://launchpad.net/~openstack
Post to     : openstack at lists.launchpad.net<mailto:openstack at lists.launchpad.net>
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp

Ahmed,

It looks like there's still a problem with your endpoint configuration?  If your conf files are in fact set up correctly as advised earlier there is also a potential that you didn't clean up the nova-volume settings you had in keystone and the CS.  Depending on your system, you might want to consider dropping the tables from your DB and starting from scratch and install cinder only.

Thanks,
John
Ahmed,

No... sorry, I didn't mean re-install the OS, just reconfigure OpenStack from scratch (drop the databases [NOT the mysql and other defaults]) and step back through the config without the nova-volume piece in the mix.

The malformed request is telling you that there's something that the receiving end does not like about the call you've made.  The reason I suspect the endpoint or catalog service issue is that I've made the same mistake and seen the same error myself :)

Thanks,
John
Ahmed,

Sorry this has been so much trouble for you, it looks like the only thing missing now is your iscsi/tgt setup.  Double check the items in step 13 on Migrate Wiki.

http://wiki.openstack.org/MigrateToCinder

Thanks,
John

_______________________________________________
Mailing list: https://launchpad.net/~openstack
Post to     : openstack at lists.launchpad.net<mailto:openstack at lists.launchpad.net>
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20121108/3d4558a5/attachment.html>


More information about the Openstack mailing list