18 Feb
2019
18 Feb
'19
8:22 a.m.
You should try to determine what caused this condition. In all likelihood you ran out of resources on these nodes (memory is a likely culprit).
Restarting pacemaker on the nodes where services are no longer running should bring them back up but you probably want to check that the nodes are back in a good state before you do so. You can also reboot the nodes but keep in mind that if you're running ceph and your ceph mons live on your controllers you can only have one ceph mon offline at a time. Any less than two active monitors and your storage will go offline.