<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 14 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:SimSun;
panose-1:2 1 6 0 3 1 1 1 1 1;}
@font-face
{font-family:SimSun;
panose-1:2 1 6 0 3 1 1 1 1 1;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:"\@SimSun";
panose-1:2 1 6 0 3 1 1 1 1 1;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p
{mso-style-priority:99;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri","sans-serif";
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri","sans-serif";}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p style="mso-margin-top-alt:0in;margin-right:0in;margin-bottom:.2in;margin-left:0in;line-height:13.5pt;background:white">
<span style="font-size:9.0pt;font-family:"Courier New";color:#333333">Hi list,<o:p></o:p></span></p>
<p style="mso-margin-top-alt:0in;margin-right:0in;margin-bottom:.2in;margin-left:0in;line-height:13.5pt;background:white">
<span style="font-size:9.0pt;font-family:"Courier New";color:#333333">I'm working under CentOS 6.4 + Havava.<o:p></o:p></span></p>
<p style="mso-margin-top-alt:0in;margin-right:0in;margin-bottom:.2in;margin-left:0in;line-height:13.5pt;background:white;max-width: 45em;orphans: auto;widows: auto;-webkit-text-stroke-width: 0px;word-spacing:0px">
<span style="font-size:9.0pt;font-family:"Courier New";color:#333333">I'm using ceph working as cinder backend.<br>
For, glance, image is stored in local file system.<o:p></o:p></span></p>
<p style="mso-margin-top-alt:0in;margin-right:0in;margin-bottom:.2in;margin-left:0in;line-height:13.5pt;background:white;max-width: 45em;orphans: auto;widows: auto;-webkit-text-stroke-width: 0px;word-spacing:0px">
<span style="font-size:9.0pt;font-family:"Courier New";color:#333333">I want to create a volume from a image.<br>
So I run command<br>
"cinder create --image-id ${image_id} --display-name ${name} ${size}"<o:p></o:p></span></p>
<p style="mso-margin-top-alt:0in;margin-right:0in;margin-bottom:.2in;margin-left:0in;line-height:13.5pt;background:white;max-width: 45em;orphans: auto;widows: auto;-webkit-text-stroke-width: 0px;word-spacing:0px">
<span style="font-size:9.0pt;font-family:"Courier New";color:#333333">First the volume is under status "downloading":<o:p></o:p></span></p>
<p style="mso-margin-top-alt:0in;margin-right:0in;margin-bottom:.2in;margin-left:0in;line-height:13.5pt;background:white;max-width: 45em;orphans: auto;widows: auto;-webkit-text-stroke-width: 0px;word-spacing:0px">
<span style="font-size:9.0pt;font-family:"Courier New";color:#333333"> cinder list<br>
+--------------------------------------+-------------+--------------+------+-------------+----------+-------------+<br>
| ID | Status | Display Name | Size | Volume Type | Bootable | Attached to |<br>
+--------------------------------------+-------------+--------------+------+-------------+----------+-------------+<br>
| d626adb7-5220-4e39-a0a6-0de34a9f651c | downloading | my_image_volume| 70 | None | false | |<br>
+--------------------------------------+-------------+--------------+------+-------------+----------+-------------+<o:p></o:p></span></p>
<p style="mso-margin-top-alt:0in;margin-right:0in;margin-bottom:.2in;margin-left:0in;line-height:13.5pt;background:white;max-width: 45em;orphans: auto;widows: auto;-webkit-text-stroke-width: 0px;word-spacing:0px">
<span style="font-size:9.0pt;font-family:"Courier New";color:#333333">I assume cinder is copy the image file from glance.<o:p></o:p></span></p>
<p style="mso-margin-top-alt:0in;margin-right:0in;margin-bottom:.2in;margin-left:0in;line-height:13.5pt;background:white;max-width: 45em;orphans: auto;widows: auto;-webkit-text-stroke-width: 0px;word-spacing:0px">
<span style="font-size:9.0pt;font-family:"Courier New";color:#333333">But then, I get error in ciner volume.log, and the volume's status turned into error.<o:p></o:p></span></p>
<p style="mso-margin-top-alt:0in;margin-right:0in;margin-bottom:.2in;margin-left:0in;line-height:13.5pt;background:white;max-width: 45em;orphans: auto;widows: auto;-webkit-text-stroke-width: 0px;word-spacing:0px">
<span style="font-size:9.0pt;font-family:"Courier New";color:#333333"> cinder list<br>
+--------------------------------------+--------+--------------+------+-------------+----------+-------------+<br>
| ID | Status | Display Name | Size | Volume Type | Bootable | Attached to |<br>
+--------------------------------------+--------+--------------+------+-------------+----------+-------------+<br>
| d626adb7-5220-4e39-a0a6-0de34a9f651c | error | my_image_volume| 70 | None | false | |<br>
+--------------------------------------+--------+--------------+------+-------------+----------+-------------+<o:p></o:p></span></p>
<p style="mso-margin-top-alt:0in;margin-right:0in;margin-bottom:.2in;margin-left:0in;line-height:13.5pt;background:white;max-width: 45em;orphans: auto;widows: auto;-webkit-text-stroke-width: 0px;word-spacing:0px">
<span style="font-size:9.0pt;font-family:"Courier New";color:#333333">Anyone know why this happening ???<o:p></o:p></span></p>
<p style="mso-margin-top-alt:0in;margin-right:0in;margin-bottom:.2in;margin-left:0in;line-height:13.5pt;background:white;max-width: 45em;orphans: auto;widows: auto;-webkit-text-stroke-width: 0px;word-spacing:0px">
<span style="font-size:9.0pt;font-family:"Courier New";color:#333333">Error message in volume.log:<o:p></o:p></span></p>
<p style="mso-margin-top-alt:0in;margin-right:0in;margin-bottom:.2in;margin-left:0in;line-height:13.5pt;background:white;max-width: 45em;orphans: auto;widows: auto;-webkit-text-stroke-width: 0px;word-spacing:0px">
<span style="font-size:9.0pt;font-family:"Courier New";color:#333333">2014-03-04 05:49:11 ERROR [cinder.volume.manager] Error: ['Traceback (most recent call last):\n', ' File "/usr/lib/python2.6/site-packages/cinder/volume/manager.py", line 250, in create_volume\n
image_location)\n', ' File "/usr/lib/python2.6/site-packages/cinder/volume/manager.py", line 189, in _create_volume\n image_id)\n', ' File "/usr/lib/python2.6/site-packages/cinder/volume/manager.py", line 602, in _copy_image_to_volume\n image_id)\n', ' File
"/usr/lib/python2.6/site-packages/cinder/volume/drivers/rbd.py", line 275, in copy_image_to_volume\n tmp.name)\n', ' File "/usr/lib/python2.6/site-packages/cinder/image/image_utils.py", line 218, in fetch_to_raw\n fetch(context, image_service, image_id, tmp,
user_id, project_id)\n', ' File "/usr/lib/python2.6/site-packages/cinder/image/image_utils.py", line 201, in fetch\n image_service.download(context, image_id, image_file)\n', ' File "/usr/lib64/python2.6/contextlib.py", line 34, in __exit__\n self.gen.throw(type,
value, traceback)\n', ' File "/usr/lib/python2.6/site-packages/cinder/utils.py", line 946, in remove_path_on_error\n delete_if_exists(path)\n', ' File "/usr/lib64/python2.6/contextlib.py", line 23, in __exit__\n self.gen.next()\n', ' File "/usr/lib/python2.6/site-packages/cinder/utils.py",
line 943, in remove_path_on_error\n yield\n', ' File "/usr/lib/python2.6/site-packages/cinder/image/image_utils.py", line 201, in fetch\n image_service.download(context, image_id, image_file)\n', ' File "/usr/lib/python2.6/site-packages/cinder/image/glance.py",
line 235, in download\n data.write(chunk)\n', 'IOError: [Errno 28] No space left on device\n']<br>
2014-03-04 05:49:11 ERROR [cinder.volume.driver] Recovering from a failed execute. Try number 1<br>
Traceback (most recent call last):<br>
File "/usr/lib/python2.6/site-packages/cinder/volume/driver.py", line 88, in _try_execute<br>
self._execute(*command, **kwargs)<br>
File "/usr/lib/python2.6/site-packages/cinder/utils.py", line 190, in execute<br>
cmd=' '.join(cmd))<br>
ProcessExecutionError: Unexpected error while running command.<br>
Command: rbd create --pool specweb --size 71680 volume-d626adb7-5220-4e39-a0a6-0de34a9f651c --new-format<br>
Exit code: 1<br>
Stdout: ''<br>
Stderr: 'rbd: create error: (17) File exists\n2014-03-04 05:49:11.565446 7fb55f8f2760 -1 librbd: rbd image volume-d626adb7-5220-4e39-a0a6-0de34a9f651c already exists\n'<br>
2014-03-04 05:49:12 ERROR [cinder.volume.driver] Recovering from a failed execute. Try number 2<br>
Traceback (most recent call last):<br>
File "/usr/lib/python2.6/site-packages/cinder/volume/driver.py", line 88, in _try_execute<br>
self._execute(*command, **kwargs)<br>
File "/usr/lib/python2.6/site-packages/cinder/utils.py", line 190, in execute<br>
cmd=' '.join(cmd))<br>
ProcessExecutionError: Unexpected error while running command.<br>
Command: rbd create --pool specweb --size 71680 volume-d626adb7-5220-4e39-a0a6-0de34a9f651c --new-format<br>
Exit code: 1<br>
Stdout: ''<br>
Stderr: 'rbd: create error: (17) File exists\n2014-03-04 05:49:12.675129 7f591067e760 -1 librbd: rbd image volume-d626adb7-5220-4e39-a0a6-0de34a9f651c already exists\n'<br>
2014-03-04 05:49:16 ERROR [cinder.volume.manager] Error: ['Traceback (most recent call last):\n', ' File "/usr/lib/python2.6/site-packages/cinder/volume/manager.py", line 250, in create_volume\n image_location)\n', ' File "/usr/lib/python2.6/site-packages/cinder/volume/manager.py",
line 180, in _create_volume\n model_update = self.driver.create_volume(volume_ref)\n', ' File "/usr/lib/python2.6/site-packages/cinder/volume/drivers/rbd.py", line 116, in create_volume\n self._try_execute(*args)\n', ' File "/usr/lib/python2.6/site-packages/cinder/volume/driver.py",
line 88, in _try_execute\n self._execute(*command, **kwargs)\n', ' File "/usr/lib/python2.6/site-packages/cinder/utils.py", line 190, in execute\n cmd=\' \'.join(cmd))\n', "ProcessExecutionError: Unexpected error while running command.\nCommand: rbd create
--pool specweb --size 71680 volume-d626adb7-5220-4e39-a0a6-0de34a9f651c --new-format\nExit code: 1\nStdout: ''\nStderr: 'rbd: create error: (17) File exists\\n2014-03-04 05:49:16.722241 7f9264b76760 -1 librbd: rbd image volume-d626adb7-5220-4e39-a0a6-0de34a9f651c
already exists\\n'\n"]<br>
2014-03-04 05:49:17 ERROR [cinder.volume.driver] Recovering from a failed execute. Try number 1<br>
Traceback (most recent call last):<br>
File "/usr/lib/python2.6/site-packages/cinder/volume/driver.py", line 88, in _try_execute<br>
self._execute(*command, **kwargs)<br>
File "/usr/lib/python2.6/site-packages/cinder/utils.py", line 190, in execute<br>
cmd=' '.join(cmd))<br>
ProcessExecutionError: Unexpected error while running command.<br>
Command: rbd create --pool specweb --size 71680 volume-d626adb7-5220-4e39-a0a6-0de34a9f651c --new-format<br>
Exit code: 1<br>
Stdout: ''<br>
Stderr: 'rbd: create error: (17) File exists\n2014-03-04 05:49:17.152936 7fd25dec2760 -1 librbd: rbd image volume-d626adb7-5220-4e39-a0a6-0de34a9f651c already exists\n'<br>
2014-03-04 05:49:18 ERROR [cinder.volume.driver] Recovering from a failed execute. Try number 2<br>
Traceback (most recent call last):<br>
File "/usr/lib/python2.6/site-packages/cinder/volume/driver.py", line 88, in _try_execute<br>
self._execute(*command, **kwargs)<br>
File "/usr/lib/python2.6/site-packages/cinder/utils.py", line 190, in execute<br>
cmd=' '.join(cmd))<br>
ProcessExecutionError: Unexpected error while running command.<br>
Command: rbd create --pool specweb --size 71680 volume-d626adb7-5220-4e39-a0a6-0de34a9f651c --new-format<br>
Exit code: 1<br>
Stdout: ''<br>
Stderr: 'rbd: create error: (17) File exists2014-03-04 05:49:18.216348 7f6580deb760 -1 \nlibrbd: rbd image volume-d626adb7-5220-4e39-a0a6-0de34a9f651c already exists\n'<br>
2014-03-04 05:49:22 ERROR [cinder.volume.manager] Error: ['Traceback (most recent call last):\n', ' File "/usr/lib/python2.6/site-packages/cinder/volume/manager.py", line 250, in create_volume\n image_location)\n', ' File "/usr/lib/python2.6/site-packages/cinder/volume/manager.py",
line 180, in _create_volume\n model_update = self.driver.create_volume(volume_ref)\n', ' File "/usr/lib/python2.6/site-packages/cinder/volume/drivers/rbd.py", line 116, in create_volume\n self._try_execute(*args)\n', ' File "/usr/lib/python2.6/site-packages/cinder/volume/driver.py",
line 88, in _try_execute\n self._execute(*command, **kwargs)\n', ' File "/usr/lib/python2.6/site-packages/cinder/utils.py", line 190, in execute\n cmd=\' \'.join(cmd))\n', "ProcessExecutionError: Unexpected error while running command.\nCommand: rbd create
--pool specweb --size 71680 volume-d626adb7-5220-4e39-a0a6-0de34a9f651c --new-format\nExit code: 1\nStdout: ''\nStderr: 'rbd: create error: (17) File exists\\n2014-03-04 05:49:22.261890 7f1c32ecc760 -1 librbd: rbd image volume-d626adb7-5220-4e39-a0a6-0de34a9f651c
already exists\\n'\n"]<o:p></o:p></span></p>
<p style="mso-margin-top-alt:0in;margin-right:0in;margin-bottom:.2in;margin-left:0in;line-height:13.5pt;background:white;max-width: 45em;orphans: auto;widows: auto;-webkit-text-stroke-width: 0px;word-spacing:0px">
<span style="font-size:9.0pt;font-family:"Courier New";color:#333333">My cinder config file /etc/cinder/cinder.conf<br>
[DEFAULT]<br>
logdir = /var/log/cinder<br>
state_path = /var/lib/cinder<br>
lock_path = /var/lib/cinder/tmp<o:p></o:p></span></p>
<p style="mso-margin-top-alt:0in;margin-right:0in;margin-bottom:.2in;margin-left:0in;line-height:13.5pt;background:white;max-width: 45em;orphans: auto;widows: auto;-webkit-text-stroke-width: 0px;word-spacing:0px">
<span style="font-size:9.0pt;font-family:"Courier New";color:#333333"> debug=False<br>
verbose=False<o:p></o:p></span></p>
<p style="mso-margin-top-alt:0in;margin-right:0in;margin-bottom:.2in;margin-left:0in;line-height:13.5pt;background:white;max-width: 45em;orphans: auto;widows: auto;-webkit-text-stroke-width: 0px;word-spacing:0px">
<span style="font-size:9.0pt;font-family:"Courier New";color:#333333"> # Backend using Ceph<br>
volume_driver = cinder.volume.drivers.rbd.RBDDriver<o:p></o:p></span></p>
<p style="mso-margin-top-alt:0in;margin-right:0in;margin-bottom:.2in;margin-left:0in;line-height:13.5pt;background:white;max-width: 45em;orphans: auto;widows: auto;-webkit-text-stroke-width: 0px;word-spacing:0px">
<span style="font-size:9.0pt;font-family:"Courier New";color:#333333"> rbd_pool = cinderpool<br>
rbd_ceph_conf=/etc/ceph/ceph.conf<o:p></o:p></span></p>
<p style="mso-margin-top-alt:0in;margin-right:0in;margin-bottom:.2in;margin-left:0in;line-height:13.5pt;background:white;max-width: 45em;orphans: auto;widows: auto;-webkit-text-stroke-width: 0px;word-spacing:0px">
<span style="font-size:9.0pt;font-family:"Courier New";color:#333333"> rbd_flatten_volume_from_snapshot=false<br>
rbd_max_clone_depth=5<o:p></o:p></span></p>
<p style="mso-margin-top-alt:0in;margin-right:0in;margin-bottom:.2in;margin-left:0in;line-height:13.5pt;background:white;max-width: 45em;orphans: auto;widows: auto;-webkit-text-stroke-width: 0px;word-spacing:0px">
<span style="font-size:9.0pt;font-family:"Courier New";color:#333333"> # glance<br>
glance_host = 192.101.11.10<br>
glance_api_version = 2<o:p></o:p></span></p>
<p style="mso-margin-top-alt:0in;margin-right:0in;margin-bottom:.2in;margin-left:0in;line-height:13.5pt;background:white;max-width: 45em;orphans: auto;widows: auto;-webkit-text-stroke-width: 0px;word-spacing:0px">
<span style="font-size:9.0pt;font-family:"Courier New";color:#333333"> # database<br>
sql_connection = mysql://cinder:cinder@192.168.11.11/cinder<o:p></o:p></span></p>
<p style="mso-margin-top-alt:0in;margin-right:0in;margin-bottom:.2in;margin-left:0in;line-height:13.5pt;background:white;max-width: 45em;orphans: auto;widows: auto;-webkit-text-stroke-width: 0px;word-spacing:0px">
<span style="font-size:9.0pt;font-family:"Courier New";color:#333333"> # rpc<br>
rpc_backend = cinder.openstack.common.rpc.impl_qpid<br>
qpid_hostname=192.168.11.11<br>
qpid_port=5672<o:p></o:p></span></p>
<p style="mso-margin-top-alt:0in;margin-right:0in;margin-bottom:.2in;margin-left:0in;line-height:13.5pt;background:white;max-width: 45em;orphans: auto;widows: auto;-webkit-text-stroke-width: 0px;word-spacing:0px">
<span style="font-size:9.0pt;font-family:"Courier New";color:#333333"> # rootwrap<br>
rootwrap_config = /etc/cinder/rootwrap.conf<o:p></o:p></span></p>
<p style="mso-margin-top-alt:0in;margin-right:0in;margin-bottom:.2in;margin-left:0in;line-height:13.5pt;background:white;max-width: 45em;orphans: auto;widows: auto;-webkit-text-stroke-width: 0px;word-spacing:0px">
<span style="font-size:9.0pt;font-family:"Courier New";color:#333333"> auth_strategy=keystone<o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</body>
</html>