Open Stack

On Thu, Sep 21, 2017 at 12:58:58PM +1000, Ian Wienand wrote:
> 
> At around Sep 21 02:30UTC mirror01.bhs1.ovh.openstack.org became
> uncontactable and jobs in the region started to fail.
> 
> The server was in an ACTIVE state but uncontactable.  I attempted to
> get a console but either a log or url request returned 500 (request
> id's below if it helps).
> 
>  ... console url show ...
> The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-5da4cba2-efe8-4dfb-a8a7-faf490075c89)
>  ...  console log show ...
> The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-80beb593-b565-42eb-8a97-b2a208e3d865)
> 
> I could not figure out how to log into the web console with our
> credentials.
> 
> I attempted to hard-reboot it, and it currently appears stuck in
> HARD_REBOOT.  Thus I have placed nodepool.o.o in the emergency file
> and set max-servers for the ovh-bhs1 region to 0
> 
> I have left it at this, as hopefully it will be beneficial for both
> OVH and us to diagnose the issue since the host was definitely not
> expected to disappear.  After this we can restore or rebuild it as
> required.
> 
> Thanks,
> 
http://mirror01.bhs1.ovh.openstack.org/ appears to be back online, I'll confirm
if we want to remove nodepool from the emergency file. And try to reach out to
OVH.

> -i
> 
> _______________________________________________
> OpenStack-Infra mailing list
> OpenStack-Infra at lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-infra