<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 14 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
{font-family:Consolas;
panose-1:2 11 6 9 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
pre
{mso-style-priority:99;
mso-style-link:"HTML Preformatted Char";
margin:0in;
margin-bottom:.0001pt;
font-size:10.0pt;
font-family:"Courier New";}
span.HTMLPreformattedChar
{mso-style-name:"HTML Preformatted Char";
mso-style-priority:99;
mso-style-link:"HTML Preformatted";
font-family:"Courier New";}
span.EmailStyle19
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:windowtext;}
span.EmailStyle20
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><a name="_MailEndCompose"><span style="color:#1F497D">Sorry forgot to add the volume details attached to the vm<o:p></o:p></span></a></p>
<p class="MsoNormal"><span style="color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:#1F497D">[root@openstack ~(keystone_admin)]# openstack volume show f1ac2e94-b0ed-4089-898f-5b6467fb51e3<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:#1F497D">+--------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:#1F497D">| Field | Value
|<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:#1F497D">+--------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:#1F497D">| attachments | [{u'server_id': u'1e59f329-072e-48ae-abf1-266eba437508', u'attachment_id': u'9634e683-2d71-483b-8c1a-7aedd9c8c7d8', u'attached_at': u'2018-05-29T11:22:12.000000',
u'host_name': None, u'volume_id': |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:#1F497D">| | u'f1ac2e94-b0ed-4089-898f-5b6467fb51e3', u'device': u'/dev/vda', u'id': u'f1ac2e94-b0ed-4089-898f-5b6467fb51e3'}]
|<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:#1F497D">| availability_zone | nova
|<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:#1F497D">| bootable | true
|<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:#1F497D">| consistencygroup_id | None
|<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:#1F497D">| created_at | 2017-03-01T00:53:07.000000
|<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:#1F497D">| description |
|<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:#1F497D">| encrypted | False
|<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:#1F497D">| id | f1ac2e94-b0ed-4089-898f-5b6467fb51e3
|<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:#1F497D">| migration_status | None
|<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:#1F497D">| multiattach | False
|<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:#1F497D">| name |
|<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:#1F497D">| os-vol-host-attr:host | openstack.localdomain@lvm#lvm
|<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:#1F497D">| os-vol-mig-status-attr:migstat | None
|<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:#1F497D">| os-vol-mig-status-attr:name_id | None
|<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:#1F497D">| os-vol-tenant-attr:tenant_id | 847121649d804ebca4da5260979118d1
|<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:#1F497D">| properties | attached_mode='rw', readonly='False'
|<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:#1F497D">| replication_status | disabled
|<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:#1F497D">| size | 700
|<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:#1F497D">| snapshot_id | None
|<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:#1F497D">| source_volid | None
|<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:#1F497D">| status | in-use
|<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:#1F497D">| type | iscsi
|<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:#1F497D">| updated_at | 2018-05-29T11:22:12.000000
|<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:#1F497D">| user_id | cce14e7b44254074941b1cff2cf519ae
|<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:#1F497D">| volume_image_metadata | {u'container_format': u'bare', u'min_ram': u'0', u'disk_format': u'qcow2', u'image_name': u'centos7', u'image_id': u'7047b9a6-f0a2-415a-8ea7-af834146260f',
u'checksum': u'bc62ad193b085680952edfa7face0f23', |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:#1F497D">| | u'min_disk': u'0', u'size': u'1361182720'}
|<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:#1F497D">+--------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"><o:p> </o:p></span></p>
<div>
<p class="MsoNormal"><span style="color:#1F497D">Manuel<o:p></o:p></span></p>
</div>
<p class="MsoNormal"><span style="color:#1F497D"><o:p> </o:p></span></p>
<div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> Manuel Sopena Ballesteros
<br>
<b>Sent:</b> Monday, October 8, 2018 4:25 PM<br>
<b>To:</b> openstack@lists.openstack.org<br>
<b>Subject:</b> vm not starting<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><span style="font-family:"Arial","sans-serif";color:black">Dear Openstack community,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Arial","sans-serif";color:black"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Arial","sans-serif";color:black">I had to reboot my server and now I can’t start one of the vms (danrod-server) which boots from volume.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black"><o:p> </o:p></span></p>
<p class="MsoNormal"><b><u><span style="font-family:"Arial","sans-serif";color:black">vm details<o:p></o:p></span></u></b></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">[root@openstack ~(keystone_admin)]# openstack server show danrod-server<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">+--------------------------------------+----------------------------------------------------------+<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">| Field | Value |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">+--------------------------------------+----------------------------------------------------------+<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">| OS-DCF:diskConfig | MANUAL |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">| OS-EXT-AZ:availability_zone | nova |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">| OS-EXT-SRV-ATTR:host | openstack.localdomain |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">| OS-EXT-SRV-ATTR:hypervisor_hostname | openstack.localdomain |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">| OS-EXT-SRV-ATTR:instance_name | instance-00000069 |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">| OS-EXT-STS:power_state | NOSTATE |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">| OS-EXT-STS:task_state | None |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">| OS-EXT-STS:vm_state | stopped |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">| OS-SRV-USG:launched_at | 2018-05-29T11:22:17.000000 |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">| OS-SRV-USG:terminated_at | None |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">| accessIPv4 | |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">| accessIPv6 | |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">| addresses | privatenetwork=192.168.1.105, 129.94.14.238 |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">| config_drive | |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">| created | 2018-05-29T11:22:09Z |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">| flavor | xlarge.cpu.xxxlarge.ram (6) |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">| hostId | ecef276660cd714fe626073a18c11fe1c00bec91c15516178fb6ac28 |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">| id | 1e59f329-072e-48ae-abf1-266eba437508 |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">| image | |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">| key_name | None |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">| name | danrod-server |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">| os-extended-volumes:volumes_attached | [{u'id': u'f1ac2e94-b0ed-4089-898f-5b6467fb51e3'}] |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">| project_id | d58cf22d960e4de49b71658aee642e94 |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">| properties | |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">| security_groups | [{u'name': u'admin'}, {u'name': u'R-Studio Server'}] |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">| status | SHUTOFF |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">| updated | 2018-10-08T02:52:41Z |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">| user_id | c412f34c353244eabecd4b6dc4d36392 |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">+--------------------------------------+----------------------------------------------------------+<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black"><o:p> </o:p></span></p>
<p class="MsoNormal"><b><u><span style="font-family:"Arial","sans-serif";color:black">List of volumes<o:p></o:p></span></u></b></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">[root@openstack ~(keystone_admin)]# openstack volume list --all<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">+--------------------------------------+--------------+--------+------+----------------------------------------+<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">| ID | Display Name | Status | Size | Attached to |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">+--------------------------------------+--------------+--------+------+----------------------------------------+<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">| f1ac2e94-b0ed-4089-898f-5b6467fb51e3 | | in-use | 700 | Attached to danrod-server on /dev/vda |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">+--------------------------------------+--------------+--------+------+----------------------------------------+<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black"><o:p> </o:p></span></p>
<p class="MsoNormal"><b><u><span style="font-family:"Arial","sans-serif";color:black">nova-compute.log<o:p></o:p></span></u></b></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:51:46.476 4015 INFO os_brick.initiator.connectors.iscsi [req-d9ed864b-9a4f-4182-b91b-9a2f1e38fb02 c412f34c353244eabecd4b6dc4d36392 d58cf22d960e4de49b71658aee642e94 - - -]
Multipath discovery for iSCSI not enabled.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:51:46.476 4015 INFO os_brick.initiator.connectors.iscsi [req-d9ed864b-9a4f-4182-b91b-9a2f1e38fb02 c412f34c353244eabecd4b6dc4d36392 d58cf22d960e4de49b71658aee642e94 - - -]
Trying to connect to iSCSI portal 129.94.14.254:3260<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:51:46.504 4015 WARNING os_brick.initiator.connectors.iscsi [req-d9ed864b-9a4f-4182-b91b-9a2f1e38fb02 c412f34c353244eabecd4b6dc4d36392 d58cf22d960e4de49b71658aee642e94 - -
-] ISCSI volume not yet found at: [u'/dev/disk/by-path/ip-129.94.14.254:3260-iscsi-iqn.2010-10.org.openstack:volume-f1ac2e94-b0ed-4089-898f-5b6467fb51e3-lun-0']. Will rescan & retry. Try number: 0.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:51:47.510 4015 WARNING os_brick.initiator.connectors.iscsi [req-d9ed864b-9a4f-4182-b91b-9a2f1e38fb02 c412f34c353244eabecd4b6dc4d36392 d58cf22d960e4de49b71658aee642e94 - -
-] ISCSI volume not yet found at: [u'/dev/disk/by-path/ip-129.94.14.254:3260-iscsi-iqn.2010-10.org.openstack:volume-f1ac2e94-b0ed-4089-898f-5b6467fb51e3-lun-0']. Will rescan & retry. Try number: 1.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:51:51.519 4015 WARNING os_brick.initiator.connectors.iscsi [req-d9ed864b-9a4f-4182-b91b-9a2f1e38fb02 c412f34c353244eabecd4b6dc4d36392 d58cf22d960e4de49b71658aee642e94 - -
-] ISCSI volume not yet found at: [u'/dev/disk/by-path/ip-129.94.14.254:3260-iscsi-iqn.2010-10.org.openstack:volume-f1ac2e94-b0ed-4089-898f-5b6467fb51e3-lun-0']. Will rescan & retry. Try number: 2.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:00.527 4015 WARNING os_brick.initiator.connectors.iscsi [req-d9ed864b-9a4f-4182-b91b-9a2f1e38fb02 c412f34c353244eabecd4b6dc4d36392 d58cf22d960e4de49b71658aee642e94 - -
-] ISCSI volume not yet found at: [u'/dev/disk/by-path/ip-129.94.14.254:3260-iscsi-iqn.2010-10.org.openstack:volume-f1ac2e94-b0ed-4089-898f-5b6467fb51e3-lun-0']. Will rescan & retry. Try number: 3.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:16.535 4015 WARNING os_brick.initiator.connectors.iscsi [req-d9ed864b-9a4f-4182-b91b-9a2f1e38fb02 c412f34c353244eabecd4b6dc4d36392 d58cf22d960e4de49b71658aee642e94 - -
-] ISCSI volume not yet found at: [u'/dev/disk/by-path/ip-129.94.14.254:3260-iscsi-iqn.2010-10.org.openstack:volume-f1ac2e94-b0ed-4089-898f-5b6467fb51e3-lun-0']. Will rescan & retry. Try number: 4.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:23.357 4015 INFO nova.compute.resource_tracker [req-359039dc-29dc-4f06-805f-0ca943bb600f - - - - -] Auditing locally available compute resources for node openstack.localdomain<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:23.713 4015 INFO nova.compute.resource_tracker [req-359039dc-29dc-4f06-805f-0ca943bb600f - - - - -] Total usable vcpus: 56, total allocated vcpus: 52<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:23.713 4015 INFO nova.compute.resource_tracker [req-359039dc-29dc-4f06-805f-0ca943bb600f - - - - -] Final resource view: name=openstack.localdomain phys_ram=524173MB used_ram=454608MB
phys_disk=9312GB used_disk=1540GB total_vcpus=56 used_vcpus=52 pci_stats=[]<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:23.733 4015 INFO nova.compute.resource_tracker [req-359039dc-29dc-4f06-805f-0ca943bb600f - - - - -] Compute_service record updated for openstack.localdomain:openstack.localdomain<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.665 4015 INFO nova.compute.manager [req-d9ed864b-9a4f-4182-b91b-9a2f1e38fb02 c412f34c353244eabecd4b6dc4d36392 d58cf22d960e4de49b71658aee642e94 - - -] [instance: 1e59f329-072e-48ae-abf1-266eba437508]
Successfully reverted task state from powering-on on failure for instance.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server [req-d9ed864b-9a4f-4182-b91b-9a2f1e38fb02 c412f34c353244eabecd4b6dc4d36392 d58cf22d960e4de49b71658aee642e94 - - -] Exception
during message handling<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server Traceback (most recent call last):<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 133, in _process_incoming<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 150, in dispatch<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 121, in _do_dispatch<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/nova/exception_wrapper.py", line 75, in wrapped<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server function_name, call_dict, binary)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server self.force_reraise()<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/nova/exception_wrapper.py", line 66, in wrapped<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server return f(self, context, *args, **kw)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 188, in decorated_function<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server LOG.warning(msg, e, instance=instance)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server self.force_reraise()<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 157, in decorated_function<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server return function(self, context, *args, **kwargs)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/nova/compute/utils.py", line 613, in decorated_function<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server return function(self, context, *args, **kwargs)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 216, in decorated_function<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server kwargs['instance'], e, sys.exc_info())<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server self.force_reraise()<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 204, in decorated_function<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server return function(self, context, *args, **kwargs)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2475, in start_instance<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server self._power_on(context, instance)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2445, in _power_on<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server block_device_info)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 2434, in power_on<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server self._hard_reboot(context, instance, network_info, block_device_info)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 2307, in _hard_reboot<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server block_device_info=block_device_info)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4658, in _get_guest_xml<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server context)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4483, in _get_guest_config<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server flavor, guest.os_type)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 3523, in _get_guest_storage_config<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server self._connect_volume(connection_info, info)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 1099, in _connect_volume<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server vol_driver.connect_volume(connection_info, disk_info)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/volume/iscsi.py", line 64, in connect_volume<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server device_info = self.connector.connect_volume(connection_info['data'])<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/os_brick/utils.py", line 137, in trace_logging_wrapper<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server return f(*args, **kwargs)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py", line 271, in inner<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server return f(*args, **kwargs)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/os_brick/initiator/connectors/iscsi.py", line 404, in connect_volume<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server raise exception.VolumeDeviceNotFound(device=host_devices)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server VolumeDeviceNotFound: Volume device not found at [u'/dev/disk/by-path/ip-129.94.14.254:3260-iscsi-iqn.2010-10.org.openstack:volume-f1ac2e94-b0ed-4089-898f-5b6467fb51e3-lun-0'].<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">2018-10-08 13:52:41.672 4015 ERROR oslo_messaging.rpc.server<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black"><o:p> </o:p></span></p>
<p class="MsoNormal"><b><u><span style="font-family:"Arial","sans-serif";color:black">Cinder logs<o:p></o:p></span></u></b></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">2018-10-08 08:52:58.368 7069 ERROR oslo.messaging._drivers.impl_rabbit [-] [3dce0b7f-7eea-45e9-9fa5-220e783c0401] AMQP server 129.94.14.254:5672 closed the connection. Check login credentials:
Socket closed<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">2018-10-08 08:52:59.395 7069 ERROR oslo.messaging._drivers.impl_rabbit [-] [3dce0b7f-7eea-45e9-9fa5-220e783c0401] AMQP server on 129.94.14.254:5672 is unreachable: [Errno 111] ECONNREFUSED.
Trying again in 2 seconds. Client port: 60428<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">2018-10-08 08:53:01.404 7069 ERROR oslo.messaging._drivers.impl_rabbit [-] [3dce0b7f-7eea-45e9-9fa5-220e783c0401] AMQP server on 129.94.14.254:5672 is unreachable: [Errno 111] ECONNREFUSED.
Trying again in 4 seconds. Client port: 60428<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">2018-10-08 08:53:04.131 7069 ERROR cinder.service [req-f6138d6c-a09f-4ed4-881f-ed095d172461 - - - - -] model server went away<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">2018-10-08 08:53:04.131 7069 ERROR cinder.service Traceback (most recent call last):<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">2018-10-08 08:53:04.131 7069 ERROR cinder.service File "/usr/lib/python2.7/site-packages/cinder/service.py", line 445, in report_state<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">2018-10-08 08:53:04.131 7069 ERROR cinder.service service_ref = objects.Service.get_by_id(ctxt, self.service_id)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">2018-10-08 08:53:04.131 7069 ERROR cinder.service File "/usr/lib/python2.7/site-packages/cinder/objects/base.py", line 287, in get_by_id<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">2018-10-08 08:53:04.131 7069 ERROR cinder.service orm_obj = db.get_by_id(context, cls.model, id, *args, **kwargs)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">2018-10-08 08:53:04.131 7069 ERROR cinder.service File "/usr/lib/python2.7/site-packages/cinder/db/api.py", line 1624, in get_by_id<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">2018-10-08 08:53:04.131 7069 ERROR cinder.service return IMPL.get_by_id(context, model, id, *args, **kwargs)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">2018-10-08 08:53:04.131 7069 ERROR cinder.service File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 196, in wrapper<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">2018-10-08 08:53:04.131 7069 ERROR cinder.service return f(*args, **kwargs)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">2018-10-08 08:53:04.131 7069 ERROR cinder.service File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 6204, in get_by_id<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">2018-10-08 08:53:04.131 7069 ERROR cinder.service return _GET_METHODS[model](context, id, *args, **kwargs)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">2018-10-08 08:53:04.131 7069 ERROR cinder.service File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 178, in wrapper<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">2018-10-08 08:53:04.131 7069 ERROR cinder.service return f(*args, **kwargs)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">2018-10-08 08:53:04.131 7069 ERROR cinder.service File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 483, in service_get<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">2018-10-08 08:53:04.131 7069 ERROR cinder.service service = None if not query else query.first()<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas;color:black">…<o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><b><u><span style="font-family:"Arial","sans-serif"">However the connection to the rabbitmq server is fine?<o:p></o:p></span></u></b></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><span style="font-family:Consolas">[root@openstack ~(keystone_admin)]# sudo ss -nolpt | grep 5672<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">LISTEN 0 128 *:25672 *:* users:(("beam.smp",pid=2465,fd=43))<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">LISTEN 0 128 :::5672 :::* users:(("beam.smp",pid=2465,fd=52))<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">[root@openstack ~(keystone_admin)]# telnet 129.94.14.254 5672<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">Trying 129.94.14.254...<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">Connected to 129.94.14.254.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">Escape character is '^]'.<o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><span style="font-family:"Arial","sans-serif"">Any advice in regards how to fix this issue and be able to bring the vm back online would be highly appreciated?<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Arial","sans-serif""><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Arial","sans-serif"">Thank you very much<o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><b><span style="color:#333333;background:white">Manuel Sopena Ballesteros </span></b><span style="color:#333333;background:white">|<b> </b>Big data Engineer</span><span style="color:#333333"><br>
<b><span style="background:white">Garvan Institute of Medical Research </span></b><br>
<span style="background:white">The Kinghorn Cancer Centre,<b> </b>370 Victoria Street, Darlinghurst, NSW 2010</span><br>
<b><span style="background:white">T:</span></b><span style="background:white"> + 61 (0)2 9355 5760 | <b>F:</b> +61 (0)2 9295 8507 | <b>E:</b> </span></span><span style="color:black"><a href="mailto:manuel.sb@garvan.org.au">manuel.sb@garvan.org.au</a><o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div style="font-size:8pt; font-family: Arial">NOTICE</div>
<div style="font-size:8pt; font-family: Arial">Please consider the environment before printing this email. This message and any attachments are intended for the addressee named and may contain legally privileged/confidential/copyright information. If you are
not the intended recipient, you should not read, use, disclose, copy or distribute this communication. If you have received this message in error please notify us at once by return email and then delete both messages. We accept no liability for the distribution
of viruses or similar in electronic communications. This notice should not be removed.
</div>
</body>
</html>