beginning with [masakari]
Hi, i have recently started working on Masakari so i wanted some help with it please i was trying to test the masakari-instance_monitor & masakari-host-monitor but having trouble with it logs from host monitor pods
Stdout: '' Stderr: 'Connection to the CIB manager failed: Transport endpoint is not connected\nInit failed, could not perform requested operations\n': oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command. 2023-12-05 14:36:50.199 1 WARNING masakarimonitors.hostmonitor.host_handler.handle_host [-] hostmonitor skips monitoring hosts. 2023-12-05 14:38:50.299 1 INFO masakarimonitors.hostmonitor.host_handler.handle_host [-] Works on pacemaker-remote. 2023-12-05 14:38:50.309 1 WARNING masakarimonitors.hostmonitor.host_handler.handle_host [-] Exception caught: Unexpected error while running command. Command: cibadmin --query Exit code: 102
logs from instance monitor pod
2023-12-05 14:04:38.340 1 ERROR masakarimonitors.ha.masakari [-] Exception caught: BadRequestException: 400: Client Error for url: http://masakari-api.openstack.svc.cluster.local:15868/v1/7b473b7ad14846938ce..., Host with name lab-11053-26006-cmp-2 could not be found.: openstack.exceptions.BadRequestException: BadRequestException: 400: Client Error for url: http://masakari-api.openstack.svc.cluster.local:15868/v1/7b473b7ad14846938ce..., Host with name lab-11053-26006-cmp-2 could not be found. masakari-instance-monitor-kbfkv masakari-instance-monitor 2023-12-05 14:04:38.340 1 ERROR masakarimonitors.ha.masakari Traceback (most recent call last): masakari-instance-monitor-kbfkv masakari-instance-monitor 2023-12-05 14:04:38.340 1 ERROR masakarimonitors.ha.masakari File "/var/lib/openstack/lib/python3.8/site-packages/masakarimonitors/ha/masakari.py", line 60, in send_notification masakari-instance-monitor-kbfkv masakari-instance-monitor 2023-12-05 14:04:38.340 1 ERROR masakarimonitors.ha.masakari response = client.create_notification( masakari-instance-monitor-kbfkv masakari-instance-monitor 2023-12-05 14:04:38.340 1 ERROR masakarimonitors.ha.masakari File "/var/lib/openstack/lib/python3.8/site-packages/openstack/instance_ha/v1/_proxy.py", line 65, in create_notification masakari-instance-monitor-kbfkv masakari-instance-monitor 2023-12-05 14:04:38.340 1 ERROR masakarimonitors.ha.masakari return self._create(_notification.Notification, **attrs) masakari-instance-monitor-kbfkv masakari-instance-monitor 2023-12-05 14:04:38.340 1 ERROR masakarimonitors.ha.masakari File "/var/lib/openstack/lib/python3.8/site-packages/openstack/proxy.py", line 459, in _create masakari-instance-monitor-kbfkv masakari-instance-monitor 2023-12-05 14:04:38.340 1 ERROR masakarimonitors.ha.masakari return res.create(self, base_path=base_path) masakari-instance-monitor-kbfkv masakari-instance-monitor 2023-12-05 14:04:38.340 1 ERROR masakarimonitors.ha.masakari File "/var/lib/openstack/lib/python3.8/site-packages/openstack/resource.py", line 1343, in create masakari-instance-monitor-kbfkv masakari-instance-monitor 2023-12-05 14:04:38.340 1 ERROR masakarimonitors.ha.masakari self._translate_response(response, has_body=has_body) masakari-instance-monitor-kbfkv masakari-instance-monitor 2023-12-05 14:04:38.340 1 ERROR masakarimonitors.ha.masakari File "/var/lib/openstack/lib/python3.8/site-packages/openstack/resource.py", line 1158, in _translate_response masakari-instance-monitor-kbfkv masakari-instance-monitor 2023-12-05 14:04:38.340 1 ERROR masakarimonitors.ha.masakari exceptions.raise_from_response(response, error_message=error_message) masakari-instance-monitor-kbfkv masakari-instance-monitor 2023-12-05 14:04:38.340 1 ERROR masakarimonitors.ha.masakari File "/var/lib/openstack/lib/python3.8/site-packages/openstack/exceptions.py", line 236, in raise_from_response masakari-instance-monitor-kbfkv masakari-instance-monitor 2023-12-05 14:04:38.340 1 ERROR masakarimonitors.ha.masakari raise cls( masakari-instance-monitor-kbfkv masakari-instance-monitor 2023-12-05 14:04:38.340 1 ERROR masakarimonitors.ha.masakari openstack.exceptions.BadRequestException: BadRequestException: 400: Client Error for url: http://masakari-api.openstack.svc.cluster.local:15868/v1/7b473b7ad14846938ce..., Host with name lab-11053-26006-cmp-2 could not be found.
PS: i have installed pacemaker-remote on all computes if you could take a look and respond where i went wrong please im mailing you this as i couldnt find any masakari specific channel Thanking you Shubham
Well,
According to the log I have a couple of assumptions: * that hostnames in corosync might differ from ones in `openstack compute service list` output. They must be the same * These hostnames must also correlate with ones created for segments. It might be not obvious from docs, but you need to crate a failover segment in masakari API and create a record for each compute host there, with hostname that will be the same as in corosync and nova service. Also important to set control_attributes SSH and type COMPUTE when creating hosts.
ср, 6 дек. 2023 г. в 17:22, Shubham Kumar Yadav shubham.kumar.yadav369@gmail.com:
Hi, i have recently started working on Masakari so i wanted some help with it please i was trying to test the masakari-instance_monitor & masakari-host-monitor but having trouble with it logs from host monitor pods
Stdout: '' Stderr: 'Connection to the CIB manager failed: Transport endpoint is not connected\nInit failed, could not perform requested operations\n': oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command. 2023-12-05 14:36:50.199 1 WARNING masakarimonitors.hostmonitor.host_handler.handle_host [-] hostmonitor skips monitoring hosts. 2023-12-05 14:38:50.299 1 INFO masakarimonitors.hostmonitor.host_handler.handle_host [-] Works on pacemaker-remote. 2023-12-05 14:38:50.309 1 WARNING masakarimonitors.hostmonitor.host_handler.handle_host [-] Exception caught: Unexpected error while running command. Command: cibadmin --query Exit code: 102
logs from instance monitor pod
2023-12-05 14:04:38.340 1 ERROR masakarimonitors.ha.masakari [-] Exception caught: BadRequestException: 400: Client Error for url: http://masakari-api.openstack.svc.cluster.local:15868/v1/7b473b7ad14846938ce..., Host with name lab-11053-26006-cmp-2 could not be found.: openstack.exceptions.BadRequestException: BadRequestException: 400: Client Error for url: http://masakari-api.openstack.svc.cluster.local:15868/v1/7b473b7ad14846938ce..., Host with name lab-11053-26006-cmp-2 could not be found. masakari-instance-monitor-kbfkv masakari-instance-monitor 2023-12-05 14:04:38.340 1 ERROR masakarimonitors.ha.masakari Traceback (most recent call last): masakari-instance-monitor-kbfkv masakari-instance-monitor 2023-12-05 14:04:38.340 1 ERROR masakarimonitors.ha.masakari File "/var/lib/openstack/lib/python3.8/site-packages/masakarimonitors/ha/masakari.py", line 60, in send_notification masakari-instance-monitor-kbfkv masakari-instance-monitor 2023-12-05 14:04:38.340 1 ERROR masakarimonitors.ha.masakari response = client.create_notification( masakari-instance-monitor-kbfkv masakari-instance-monitor 2023-12-05 14:04:38.340 1 ERROR masakarimonitors.ha.masakari File "/var/lib/openstack/lib/python3.8/site-packages/openstack/instance_ha/v1/_proxy.py", line 65, in create_notification masakari-instance-monitor-kbfkv masakari-instance-monitor 2023-12-05 14:04:38.340 1 ERROR masakarimonitors.ha.masakari return self._create(_notification.Notification, **attrs) masakari-instance-monitor-kbfkv masakari-instance-monitor 2023-12-05 14:04:38.340 1 ERROR masakarimonitors.ha.masakari File "/var/lib/openstack/lib/python3.8/site-packages/openstack/proxy.py", line 459, in _create masakari-instance-monitor-kbfkv masakari-instance-monitor 2023-12-05 14:04:38.340 1 ERROR masakarimonitors.ha.masakari return res.create(self, base_path=base_path) masakari-instance-monitor-kbfkv masakari-instance-monitor 2023-12-05 14:04:38.340 1 ERROR masakarimonitors.ha.masakari File "/var/lib/openstack/lib/python3.8/site-packages/openstack/resource.py", line 1343, in create masakari-instance-monitor-kbfkv masakari-instance-monitor 2023-12-05 14:04:38.340 1 ERROR masakarimonitors.ha.masakari self._translate_response(response, has_body=has_body) masakari-instance-monitor-kbfkv masakari-instance-monitor 2023-12-05 14:04:38.340 1 ERROR masakarimonitors.ha.masakari File "/var/lib/openstack/lib/python3.8/site-packages/openstack/resource.py", line 1158, in _translate_response masakari-instance-monitor-kbfkv masakari-instance-monitor 2023-12-05 14:04:38.340 1 ERROR masakarimonitors.ha.masakari exceptions.raise_from_response(response, error_message=error_message) masakari-instance-monitor-kbfkv masakari-instance-monitor 2023-12-05 14:04:38.340 1 ERROR masakarimonitors.ha.masakari File "/var/lib/openstack/lib/python3.8/site-packages/openstack/exceptions.py", line 236, in raise_from_response masakari-instance-monitor-kbfkv masakari-instance-monitor 2023-12-05 14:04:38.340 1 ERROR masakarimonitors.ha.masakari raise cls( masakari-instance-monitor-kbfkv masakari-instance-monitor 2023-12-05 14:04:38.340 1 ERROR masakarimonitors.ha.masakari openstack.exceptions.BadRequestException: BadRequestException: 400: Client Error for url: http://masakari-api.openstack.svc.cluster.local:15868/v1/7b473b7ad14846938ce..., Host with name lab-11053-26006-cmp-2 could not be found.
PS: i have installed pacemaker-remote on all computes if you could take a look and respond where i went wrong please im mailing you this as i couldnt find any masakari specific channel Thanking you Shubham
participants (2)
-
Dmitriy Rabotyagov
-
Shubham Kumar Yadav