[Openstack] Cinder delete errors after massive network failure

Greg Chavez greg.chavez at gmail.com
Fri Apr 10 14:55:58 UTC 2015


Problem was in /etc/ceph/ceph.conf on the controller.  It had been updated
at some point and had bad perms (root:root, 640).  Thanks for the feedback!

--Greg

On Fri, Apr 10, 2015 at 1:35 AM, Huang Zhiteng <winston.d at gmail.com> wrote:

> Looks like your cinder-volume service (RBD driver actually) has
> problem reading {ceph-cluster-name}.conf that it needs.
>
> On Fri, Apr 10, 2015 at 11:57 AM, Greg Chavez <greg.chavez at gmail.com>
> wrote:
> > I guess the error line that bothers me the most is this one:
> >
> > Stderr: 'global_init: error reading config file.\n'
> >
> >
> > What config file is is failing to read?  Thanks.
> >
> > --Greg
> >
> > On Thu, Apr 9, 2015 at 4:58 PM, Greg Chavez <greg.chavez at gmail.com>
> wrote:
> >>
> >> Hi everyone,
> >>
> >> Having trouble deleting ceph volumes. They immediately go into an
> >> error_deleting state. In cinder-volume.log, there are repeating error
> that
> >> are exactly the same and slightly different errors when and delete
> action is
> >> made. There are no errors in cinder-api.log.
> >>
> >> Those errors along with our cinder.conf are here:
> >> http://pastebin.com/dbBXtdCJ
> >>
> >> Some background:
> >>
> >> We had a network failure about 4 weeks ago that screwed up our Grizzly
> >> OpenStack/Ceph installation something terrible. Eventually we had to
> move
> >> everything to a new set of switches. The controller node has been up
> for 24
> >> days, about two weeks before we moved to the new switches.
> >>
> >> We've been able to get Ceph up and running and get some VMs back, but
> >> we've decided to cut our losses and start migrating to our VSphere
> >> installation. We'll re-factor our hardware to a newer OpenStack install
> >> later, but now we are in the midst of a slow drawdown of Grizzly.
> >>
> >> Any idea what could be going on here? Thanks.
> >>
> >> --
> >> \*..+.-
> >> --Greg Chavez
> >> +//..;};
> >
> >
> >
> > _______________________________________________
> > Mailing list:
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
> > Post to     : openstack at lists.openstack.org
> > Unsubscribe :
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
> >
>
>
>
> --
> Regards
> Huang Zhiteng
>



-- 
\*..+.-
--Greg Chavez
+//..;};
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20150410/4f5d607e/attachment.html>


More information about the Openstack mailing list