<div dir="ltr">Hello Razique, I'm here opening this thread again, I've done some cinder delete but when I try to create another storeges it returns there's no space to create a new volume.<div><br></div><div>Here is part of my lvdisplay output:</div>

<div><br></div><div><div>Alloc PE / Size       52224 / 204,00 GiB</div><div>Free  PE / Size       19350 / 75,59 GiB</div></div><div><br></div><div>And here is my lvdisplay:</div><div><br></div><div><br></div><div class="gmail_extra">

<div class="gmail_extra">  --- Logical volume ---</div><div class="gmail_extra">  LV Name                /dev/cinder-volumes/volume-06ccd141-91c4-45e4-b21f-595f4a36779b</div><div class="gmail_extra">  VG Name                cinder-volumes</div>

<div class="gmail_extra">  LV UUID                wdqxVd-GgUQ-21O4-OWlR-sRT3-HvUA-Q8j9kL</div><div class="gmail_extra">  LV Write Access        read/write</div><div class="gmail_extra">  LV snapshot status     source of</div>

<div class="gmail_extra">                         /dev/cinder-volumes/_snapshot-04e8414e-2c0e-4fc2-8bff-43dd80ecca09 [active]</div><div class="gmail_extra">  LV Status              available</div><div class="gmail_extra">

  # open                 0</div><div class="gmail_extra">  LV Size                10,00 GiB</div><div class="gmail_extra">  Current LE             2560</div><div class="gmail_extra">  Segments               1</div><div class="gmail_extra">

  Allocation             inherit</div><div class="gmail_extra">  Read ahead sectors     auto</div><div class="gmail_extra">  - currently set to     256</div><div class="gmail_extra">  Block device           252:1</div><div class="gmail_extra">

   </div><div class="gmail_extra">  --- Logical volume ---</div><div class="gmail_extra">  LV Name                /dev/cinder-volumes/_snapshot-04e8414e-2c0e-4fc2-8bff-43dd80ecca09</div><div class="gmail_extra">  VG Name                cinder-volumes</div>

<div class="gmail_extra">  LV UUID                EZz1lC-a8H2-1PlN-pJTN-XAIm-wW0q-qtUQOc</div><div class="gmail_extra">  LV Write Access        read/write</div><div class="gmail_extra">  LV snapshot status     active destination for /dev/cinder-volumes/volume-06ccd141-91c4-45e4-b21f-595f4a36779b</div>

<div class="gmail_extra">  LV Status              available</div><div class="gmail_extra">  # open                 0</div><div class="gmail_extra">  LV Size                10,00 GiB</div><div class="gmail_extra">  Current LE             2560</div>

<div class="gmail_extra">  COW-table size         10,00 GiB</div><div class="gmail_extra">  COW-table LE           2560</div><div class="gmail_extra">  Allocated to snapshot  0,00% </div><div class="gmail_extra">  Snapshot chunk size    4,00 KiB</div>

<div class="gmail_extra">  Segments               1</div><div class="gmail_extra">  Allocation             inherit</div><div class="gmail_extra">  Read ahead sectors     auto</div><div class="gmail_extra">  - currently set to     256</div>

<div class="gmail_extra">  Block device           252:3</div><div class="gmail_extra">   </div><div class="gmail_extra">  --- Logical volume ---</div><div class="gmail_extra">  LV Name                /dev/cinder-volumes/volume-ca36920e-938e-4ad1-b9c4-74c1e28abd31</div>

<div class="gmail_extra">  VG Name                cinder-volumes</div><div class="gmail_extra">  LV UUID                b40kQV-P8N4-R6jt-k97Z-I2a1-9TXm-5GXqfz</div><div class="gmail_extra">  LV Write Access        read/write</div>

<div class="gmail_extra">  LV Status              available</div><div class="gmail_extra">  # open                 1</div><div class="gmail_extra">  LV Size                60,00 GiB</div><div class="gmail_extra">  Current LE             15360</div>

<div class="gmail_extra">  Segments               1</div><div class="gmail_extra">  Allocation             inherit</div><div class="gmail_extra">  Read ahead sectors     auto</div><div class="gmail_extra">  - currently set to     256</div>

<div class="gmail_extra">  Block device           252:4</div><div class="gmail_extra">   </div><div class="gmail_extra">  --- Logical volume ---</div><div class="gmail_extra">  LV Name                /dev/cinder-volumes/volume-70be4f36-10bd-4877-b841-80333ccfe985</div>

<div class="gmail_extra">  VG Name                cinder-volumes</div><div class="gmail_extra">  LV UUID                2YDrMs-BrYo-aQcZ-8AlX-A4La-HET1-9UQ0gV</div><div class="gmail_extra">  LV Write Access        read/write</div>

<div class="gmail_extra">  LV Status              available</div><div class="gmail_extra">  # open                 1</div><div class="gmail_extra">  LV Size                1,00 GiB</div><div class="gmail_extra">  Current LE             256</div>

<div class="gmail_extra">  Segments               1</div><div class="gmail_extra">  Allocation             inherit</div><div class="gmail_extra">  Read ahead sectors     auto</div><div class="gmail_extra">  - currently set to     256</div>

<div class="gmail_extra">  Block device           252:5</div><div class="gmail_extra">   </div><div class="gmail_extra">  --- Logical volume ---</div><div class="gmail_extra">  LV Name                /dev/cinder-volumes/volume-00c532bd-91fb-4a38-b340-4389fb7f0ed5</div>

<div class="gmail_extra">  VG Name                cinder-volumes</div><div class="gmail_extra">  LV UUID                MfVOuB-5x5A-jne3-H4Ul-4NP8-eI7b-UYSYE7</div><div class="gmail_extra">  LV Write Access        read/write</div>

<div class="gmail_extra">  LV Status              available</div><div class="gmail_extra">  # open                 0</div><div class="gmail_extra">  LV Size                1,00 GiB</div><div class="gmail_extra">  Current LE             256</div>

<div class="gmail_extra">  Segments               1</div><div class="gmail_extra">  Allocation             inherit</div><div class="gmail_extra">  Read ahead sectors     auto</div><div class="gmail_extra">  - currently set to     256</div>

<div class="gmail_extra">  Block device           252:6</div><div class="gmail_extra">   </div><div class="gmail_extra">  --- Logical volume ---</div><div class="gmail_extra">  LV Name                /dev/cinder-volumes/volume-ae133dbc-6141-48cf-beeb-9d6576e57a45</div>

<div class="gmail_extra">  VG Name                cinder-volumes</div><div class="gmail_extra">  LV UUID                53w8j3-WT4V-8m52-r6LK-ZYd3-mMHA-FtuyXV</div><div class="gmail_extra">  LV Write Access        read/write</div>

<div class="gmail_extra">  LV Status              available</div><div class="gmail_extra">  # open                 0</div><div class="gmail_extra">  LV Size                1,00 GiB</div><div class="gmail_extra">  Current LE             256</div>

<div class="gmail_extra">  Segments               1</div><div class="gmail_extra">  Allocation             inherit</div><div class="gmail_extra">  Read ahead sectors     auto</div><div class="gmail_extra">  - currently set to     256</div>

<div class="gmail_extra">  Block device           252:7</div><div class="gmail_extra">   </div><div class="gmail_extra">  --- Logical volume ---</div><div class="gmail_extra">  LV Name                /dev/cinder-volumes/volume-954d2f1b-837b-4ba5-abfd-b3610597be5e</div>

<div class="gmail_extra">  VG Name                cinder-volumes</div><div class="gmail_extra">  LV UUID                belquE-WxQ2-gt6Y-WlPE-Hmq3-B9Am-zcYD3P</div><div class="gmail_extra">  LV Write Access        read/write</div>

<div class="gmail_extra">  LV Status              available</div><div class="gmail_extra">  # open                 0</div><div class="gmail_extra">  LV Size                60,00 GiB</div><div class="gmail_extra">  Current LE             15360</div>

<div class="gmail_extra">  Segments               1</div><div class="gmail_extra">  Allocation             inherit</div><div class="gmail_extra">  Read ahead sectors     auto</div><div class="gmail_extra">  - currently set to     256</div>

<div class="gmail_extra">  Block device           252:8</div><div class="gmail_extra">   </div><div class="gmail_extra">  --- Logical volume ---</div><div class="gmail_extra">  LV Name                /dev/cinder-volumes/volume-05d037d1-4e61-4419-929a-fe340e00e1af</div>

<div class="gmail_extra">  VG Name                cinder-volumes</div><div class="gmail_extra">  LV UUID                Pt61e7-l3Nu-1IdX-T2sb-0GQD-PhS6-XtIIUj</div><div class="gmail_extra">  LV Write Access        read/write</div>

<div class="gmail_extra">  LV Status              available</div><div class="gmail_extra">  # open                 1</div><div class="gmail_extra">  LV Size                1,00 GiB</div><div class="gmail_extra">  Current LE             256</div>

<div class="gmail_extra">  Segments               1</div><div class="gmail_extra">  Allocation             inherit</div><div class="gmail_extra">  Read ahead sectors     auto</div><div class="gmail_extra">  - currently set to     256</div>

<div class="gmail_extra">  Block device           252:9</div><div class="gmail_extra">   </div><div class="gmail_extra">  --- Logical volume ---</div><div class="gmail_extra">  LV Name                /dev/cinder-volumes/volume-316f77c6-bf13-4ea4-9b98-028198f3922f</div>

<div class="gmail_extra">  VG Name                cinder-volumes</div><div class="gmail_extra">  LV UUID                e46mBx-CRps-HYKk-aJsc-XFRd-B1Rv-UVk8gT</div><div class="gmail_extra">  LV Write Access        read/write</div>

<div class="gmail_extra">  LV Status              available</div><div class="gmail_extra">  # open                 1</div><div class="gmail_extra">  LV Size                60,00 GiB</div><div class="gmail_extra">  Current LE             15360</div>

<div class="gmail_extra">  Segments               1</div><div class="gmail_extra">  Allocation             inherit</div><div class="gmail_extra">  Read ahead sectors     auto</div><div class="gmail_extra">  - currently set to     256</div>

<div class="gmail_extra">  Block device           252:10</div><div><br></div><div><br></div><div>Do you know how I can remove all of them? When I try lvremove /dev/cinder-volumes/volume-316f77c6-bf13-4ea4-9b98-028198f3922f, for example, I get:</div>

<div><br></div><div> Can't remove open logical volume "volume-316f77c6-bf13-4ea4-9b98-028198f3922f"<br></div><div><br></div><div>Thank you again.</div><div><br></div><div><br></div><br><div class="gmail_quote">

2013/11/8 Guilherme Russi <span dir="ltr"><<a href="mailto:luisguilherme.cr@gmail.com" target="_blank">luisguilherme.cr@gmail.com</a>></span><br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><div dir="ltr">Very thanks again.<div><br></div><div>Best regards.</div>

</div><div><div><div class="gmail_extra">
<br><br><div class="gmail_quote">2013/11/8 Razique Mahroua <span dir="ltr"><<a href="mailto:razique.mahroua@gmail.com" target="_blank">razique.mahroua@gmail.com</a>></span><br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><div style="word-wrap:break-word">Oh yah true!<div>not sure “conductors” exist yet for Cinder, meaning meanwhile, every node needs a direct access to the database</div>



<div>glad to hear it’s working :)</div><div><div><div><br></div><div><div><div>On 08 Nov 2013, at 08:53, Guilherme Russi <<a href="mailto:luisguilherme.cr@gmail.com" target="_blank">luisguilherme.cr@gmail.com</a>> wrote:</div>



<br><blockquote type="cite"><div dir="ltr">Hello again Razique, I've found the problem, I need to add the grants on the mysql to my another IP. Now it's working really good :D<div>I've found this link too if someone needs: <a href="http://docs.openstack.org/admin-guide-cloud/content//managing-volumes.html" target="_blank">http://docs.openstack.org/admin-guide-cloud/content//managing-volumes.html</a></div>





<div><br></div><div>Thank you so much, and if you need me just let me know.</div><div><br></div><div>Best regards.</div><div><br></div><div>Guilherme.</div><div><br></div></div><div class="gmail_extra"><br><br><div class="gmail_quote">





2013/11/8 Guilherme Russi <span dir="ltr"><<a href="mailto:luisguilherme.cr@gmail.com" target="_blank">luisguilherme.cr@gmail.com</a>></span><br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">





<div dir="ltr"><div>Hello Razique, I got a couple of doubts, do you know if I need to do something else that's is not on the link you sent me? I'm asking because I followed the configuration but it's not working, here is what I get: I've installed the cinder-volume at the second computer that have the HD, and I've changed it's cinder.conf. I've changed too the master's cinder.conf like is following:</div>






<div><br></div><div><br></div><div>[DEFAULT]</div><div>rootwrap_config = /etc/cinder/rootwrap.conf</div><div>sql_connection = <a>mysql://cinder:password@localhost/cinder</a></div><div>api_paste_confg = /etc/cinder/api-paste.ini</div>






<div>#iscsi_helper=iscsiadm</div><div>#iscsi_helper = ietadm</div><div>iscsi_helper = tgtadm</div><div>volume_name_template = volume-%s</div><div>#volume_group = cinder-volumes</div><div>verbose = True</div><div>auth_strategy = keystone</div>






<div>iscsi_ip_address = 192.168.3.1</div><div>scheduler_driver=cinder.scheduler.filter_scheduler.FilterScheduler</div><div><br></div><div># Rabbit authorization</div><div>rabbit_host = localhost</div><div>rabbit_port = 5672</div>






<div>rabbit_hosts = $rabbit_host:$rabbit_port</div><div>rabbit_use_ssl = false</div><div>rabbit_userid = guest</div><div>rabbit_password = password</div><div>#rabbit_virtual_host = /nova</div><div><br></div><div>state_path = /var/lib/cinder</div>






<div>lock_path = /var/lock/cinder</div><div>volumes_dir = /var/lib/cinder/volumes</div><div>#rpc_backend = cinder.rpc.impl_kombu</div><div><br></div><div>enabled_backends=orion-1,orion-4</div><div>[orion-1]</div><div>volume_group=cinder-volumes</div>






<div>volume_driver=cinder.volume.drivers.lvm.LVMISCSIDriver</div><div>volume_backend_name=LVM_iSCSI</div><div>[orion-4]</div><div>volume_group=cinder-volumes-2</div><div>volume_driver=cinder.volume.drivers.lvm.LVMISCSIDriver</div>






<div>volume_backend_name=LVM_iSCSI</div><div><br></div><div>The cinder.conf on the second computer is like this but the IPs are changed with the controller IP (It has the cinder-api), and when I run service cinder-volume restart at the second computer it's status is stop/waiting.</div>






<div><br></div><div>Any ideas?</div><div><br></div><div>Thanks :)</div></div><div><div><div class="gmail_extra"><br><br><div class="gmail_quote">2013/11/8 Razique Mahroua <span dir="ltr"><<a href="mailto:razique.mahroua@gmail.com" target="_blank">razique.mahroua@gmail.com</a>></span><br>






<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><div style="word-wrap:break-word">sure :)<div><br><div><div>

On 08 Nov 2013, at 05:39, Guilherme Russi <<a href="mailto:luisguilherme.cr@gmail.com" target="_blank">luisguilherme.cr@gmail.com</a>> wrote:</div>




<br><blockquote type="cite"><div dir="ltr">Oh great! I'll try here and send you the results.<div><br></div><div>Very thanks :)</div></div><div class="gmail_extra"><br><br><div class="gmail_quote">2013/11/8 Razique Mahroua <span dir="ltr"><<a href="mailto:razique.mahroua@gmail.com" target="_blank">razique.mahroua@gmail.com</a>></span><br>








<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><div style="word-wrap:break-word">If I’m not mistaken, you only need to install the “cinder-volume’ service that will update its status to your main node<div>








:)<div><br><div><div>On 08 Nov 2013, at 05:34, Guilherme Russi <<a href="mailto:luisguilherme.cr@gmail.com" target="_blank">luisguilherme.cr@gmail.com</a>> wrote:</div><br><blockquote type="cite"><div dir="ltr">




Great! I was reading the link and I have one question, do I need to install cinder at the other computer too?<div><br></div><div>Thanks :)</div></div><div class="gmail_extra"><br><br><div class="gmail_quote">

2013/11/8 Razique Mahroua <span dir="ltr"><<a href="mailto:razique.mahroua@gmail.com" target="_blank">razique.mahroua@gmail.com</a>></span><br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">










<div style="word-wrap:break-word">Ok in that case, with Grizzly you can use the “multi-backends” feature:<div><a href="https://wiki.openstack.org/wiki/Cinder-multi-backend" target="_blank">https://wiki.openstack.org/wiki/Cinder-multi-backend</a></div>










<div><br></div><div>and that should do it :)</div><div><br><div><div>On 08 Nov 2013, at 05:29, Guilherme Russi <<a href="mailto:luisguilherme.cr@gmail.com" target="_blank">luisguilherme.cr@gmail.com</a>> wrote:</div>










<br><blockquote type="cite"><div dir="ltr">It is a hard disk, my scenario is one Controller (where I have my storage cinder and my network quantum) and four compute nodes.</div><div class="gmail_extra"><br><br><div class="gmail_quote">










2013/11/8 Razique Mahroua <span dir="ltr"><<a href="mailto:razique.mahroua@gmail.com" target="_blank">razique.mahroua@gmail.com</a>></span><br>

<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><div style="word-wrap:break-word">ok !<div>what is your actual Cinder backend? Is it a hard disk, a SAN, a network volume, etc…</div>












<div><br><div><div>On 08 Nov 2013, at 05:20, Guilherme Russi <<a href="mailto:luisguilherme.cr@gmail.com" target="_blank">luisguilherme.cr@gmail.com</a>> wrote:</div><br><blockquote type="cite">

<div dir="ltr">Hi Razique, thank you for answering, I want to expand my cinder storage, is it the block storage? I'll use the storage to allow VMs to have more hard disk space.<div><br></div><div>Regards.</div><div><br>














</div><div>Guilherme.</div><div><br></div></div><div class="gmail_extra"><br><br><div class="gmail_quote">2013/11/8 Razique Mahroua <span dir="ltr"><<a href="mailto:razique.mahroua@gmail.com" target="_blank">razique.mahroua@gmail.com</a>></span><br>














<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">Hi Guilherme !<br>
Which storage do you precisely want to expand?<br>
<br>
Regards,<br>
Razique<br>
<div><br>
<br>
On 08 Nov 2013, at 04:52, Guilherme Russi <<a href="mailto:luisguilherme.cr@gmail.com" target="_blank">luisguilherme.cr@gmail.com</a>> wrote:<br>
<br>
> Hello guys, I have a Grizzly deployment running fine with 5 nodes, and I want to add more storage on it. My question is, can I install a new HD on another computer thats not the controller and link this HD with my cinder that it can be a storage too?<br>















> The computer I will install my new HD is at the same network as my cloud is. I'm asking because I haven't seen a question like that here. Does anybody knows how to do that? Have a clue? Any help is welcome.<br>















><br>
> Thank you all.<br>
><br>
> Best regards.<br>
</div>> _______________________________________________<br>
> Mailing list: <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a><br>
> Post to     : <a href="mailto:openstack@lists.openstack.org" target="_blank">openstack@lists.openstack.org</a><br>
> Unsubscribe : <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a><br>
<br>
</blockquote></div><br></div>
</blockquote></div><br></div></div></blockquote></div><br></div>
</blockquote></div><br></div></div></blockquote></div><br></div>
</blockquote></div><br></div></div></div></blockquote></div><br></div>
</blockquote></div><br></div></div></blockquote></div><br></div>
</div></div></blockquote></div><br></div>
</blockquote></div><br></div></div></div></div></blockquote></div><br></div>
</div></div></blockquote></div><br></div></div>