<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
        {font-family:"Cambria Math";
        panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
        {font-family:Calibri;
        panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
        {margin:0in;
        margin-bottom:.0001pt;
        font-size:12.0pt;
        font-family:"Times New Roman",serif;}
a:link, span.MsoHyperlink
        {mso-style-priority:99;
        color:#0563C1;
        text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
        {mso-style-priority:99;
        color:#954F72;
        text-decoration:underline;}
span.EmailStyle17
        {mso-style-type:personal-reply;
        font-family:"Calibri",sans-serif;
        color:#1F497D;}
.MsoChpDefault
        {mso-style-type:export-only;
        font-family:"Calibri",sans-serif;}
@page WordSection1
        {size:8.5in 11.0in;
        margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
        {page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="#0563C1" vlink="#954F72">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Can you look if you have errors in the nova-computes log?<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Also check if you passed the PciPassthroughFilter in the nova-scheduler log
<o:p></o:p></span></p>
<p class="MsoNormal" style="background-image:initial;background-repeat:initial"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal" style="margin-left:.5in"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">From:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> Chinmaya Dwibedy [mailto:ckdwibedy@gmail.com]
<br>
<b>Sent:</b> Tuesday, June 07, 2016 8:29 AM<br>
<b>To:</b> openstack@lists.openstack.org<br>
<b>Subject:</b> [Openstack] Issue with assignment of Intel’s QAT Card to VM (PCI-passthrough) using openstack-mitaka release on Cent OS 7.2 host<o:p></o:p></span></p>
<p class="MsoNormal" style="margin-left:.5in"><o:p> </o:p></p>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
Hi All,<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
 <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
I want the Intel’s QAT Card to be used for PCI Passthrough device. But to implement PCI-passthrough, when I launch a VM using a flavor configured for passthrough, it  gives the below errors in nova-conductor.log and instance goes into Error state. Note that,
 I have installed <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
openstack-mitaka release on host (Cent OS 7.2).  Can anyone please have a look into the below stated and let me know if I have missed anything or done anything wrong?  Thank you in advance for your support and time.<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
 <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
 <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
When I create an instance, this error is output in nova-conductor.log.<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
 <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
2016-06-06 05:42:42.005 4898 WARNING nova.scheduler.utils [req-94484e27-1998-4e3a-8aa8-06805613ae65 266f5859848e4f39b9725203dda5c3f2 4bc608763cee41d9a8df26d3ef919825 - - -] Failed to compute_task_build_instances: No valid host was found. There are not enough
 hosts available.<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
Traceback (most recent call last):<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
 <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
  File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 150, in inner<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
    return func(*args, **kwargs)<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
 <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
  File "/usr/lib/python2.7/site-packages/nova/scheduler/manager.py", line 104, in select_destinations<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
    dests = self.driver.select_destinations(ctxt, spec_obj)<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
 <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
  File "/usr/lib/python2.7/site-packages/nova/scheduler/filter_scheduler.py", line 74, in select_destinations<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
    raise exception.NoValidHost(reason=reason)<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
 <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
<b>NoValidHost: No valid host was found. There are not enough hosts available.</b><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
 <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
2016-06-06 05:42:42.006 4898 WARNING nova.scheduler.utils [req-94484e27-1998-4e3a-8aa8-06805613ae65 266f5859848e4f39b9725203dda5c3f2 4bc608763cee41d9a8df26d3ef919825 - - -] [instance: f1db1cce-0777-4f0e-a141-4b278c2d98b4] Setting instance to ERROR state<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
 <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
In order to assign Intel’s QAT  Card to VMs , followed below procedures<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
 <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
Using the PCI bus ID, found out the product id<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
 <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
 <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
1)<span style="font-size:7.0pt">      </span>[root@localhost ~(keystone_admin)]#  lspci -nn | grep QAT<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;text-indent:.25in;background-image:initial;background-repeat:initial">
83:00.0 Co-processor [0b40]: Intel Corporation DH895XCC Series QAT [8086:0435]<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;text-indent:.25in;background-image:initial;background-repeat:initial">
88:00.0 Co-processor [0b40]: Intel Corporation DH895XCC Series QAT [8086:0435]<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;text-indent:.25in;background-image:initial;background-repeat:initial">
 <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;text-indent:.25in;background-image:initial;background-repeat:initial">
 <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;text-indent:.25in;background-image:initial;background-repeat:initial">
[root@localhost ~(keystone_admin)]# cat /sys/bus/pci/devices/0000:83:00.0/device<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;text-indent:.25in;background-image:initial;background-repeat:initial">
0x0435<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;text-indent:.25in;background-image:initial;background-repeat:initial">
[root@localhost ~(keystone_admin)]# cat /sys/bus/pci/devices/0000:88:00.0/device<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;text-indent:.25in;background-image:initial;background-repeat:initial">
0x0435<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;text-indent:.25in;background-image:initial;background-repeat:initial">
[root@localhost ~(keystone_admin)]#<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;text-indent:.25in;background-image:initial;background-repeat:initial">
 <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
 <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;text-indent:.25in;background-image:initial;background-repeat:initial">
[root@localhost ~(keystone_admin)]#<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;text-indent:.25in;background-image:initial;background-repeat:initial">
 <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
2)<span style="font-size:7.0pt">      </span>Configured the below stated in nova.conf<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
 <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
 <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
pci_alias = {"name": "QuickAssist", "product_id": "0435", "vendor_id": "8086", "device_type": "type-PCI"}<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
pci_passthrough_whitelist =  [{"vendor_id":"8086","product_id":"0435"}]<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
 <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
scheduler_default_filters=RetryFilter,AvailabilityZoneFilter,RamFilter,ComputeFilter,ComputeCapabilitiesFilter,ImagePropertiesFilter,CoreFilter,<b>PciPassthroughFilter</b><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
scheduler_available_filters=nova.scheduler.filters.all_filter<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
<b> </b><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
3)<span style="font-size:7.0pt">      </span>service openstack-nova-api restart<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
4)<span style="font-size:7.0pt">      </span>systemctl  restart  openstack-nova-compute<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
<b> </b><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
5)<span style="font-size:7.0pt">      </span>[root@localhost ~(keystone_admin)]# nova flavor-list<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
+--------------------------------------+-----------------+-----------+------+-----------+------+-------+-------------+-----------+<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
| ID                                   | Name            | Memory_MB | Disk | Ephemeral | Swap | VCPUs | RXTX_Factor | Is_Public |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
+--------------------------------------+-----------------+-----------+------+-----------+------+-------+-------------+-----------+<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
| 1                                    | m1.tiny         | 512       | 1    | 0         |      | 1     | 1.0         | True      |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
| 2                                    | m1.small        | 2048      | 20   | 0         |      | 1     | 1.0         | True      |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
| 3                                    | m1.medium       | 4096      | 40   | 0         |      | 2     | 1.0         | True      |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
| 4                                    | m1.large        | 8192      | 80   | 0         |      | 4     | 1.0         | True      |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
+--------------------------------------+-----------------+-----------+------+-----------+------+-------+-------------+-----------+<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
[root@localhost ~(keystone_admin)]#<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
 <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
6)<span style="font-size:7.0pt">      </span>nova flavor-key 4 set "pci_passthrough:alias"="QuickAssist:1"<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
 <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
7)<span style="font-size:7.0pt">      </span>[root@localhost ~(keystone_admin)]# nova flavor-show 4<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
+----------------------------+--------------------------------------------+<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
| Property                   | Value                                      |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
+----------------------------+--------------------------------------------+<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
| OS-FLV-DISABLED:disabled   | False                                      |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
| OS-FLV-EXT-DATA:ephemeral  | 0                                          |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
| disk                       | 80                                         |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
| extra_specs                | {"pci_passthrough:alias": "QuickAssist:1"} |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
| id                         | 4                                          |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
| name                       | m1.large                                   |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
| os-flavor-access:is_public | True                                       |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
| ram                        | 8192                                       |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
| rxtx_factor                | 1.0                                        |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
| swap                       |                                            |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
| vcpus                      | 4                                          |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
+----------------------------+--------------------------------------------+<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
[root@localhost ~(keystone_admin)]#<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
 <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
 <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
 <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
8)<span style="font-size:7.0pt">      </span>[root@localhost ~(keystone_admin)]# nova boot --flavor 4 --key_name oskey1 --image bc859dc5-103b-428b-814f-d36e59009454 --nic net-id=e2ca118d-1f25-47de-8524-bb2a2635c4be --user-data=./myfile.txt TEST<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
WARNING: Option "--key_name" is deprecated; use "--key-name"; this option will be removed in novaclient 3.3.0.<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
+--------------------------------------+--------------------------------------------------------------------------+<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
| Property                             | Value                                                                    |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
+--------------------------------------+--------------------------------------------------------------------------+<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
| OS-DCF:diskConfig                    | MANUAL                                                                   |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
| OS-EXT-AZ:availability_zone          |                                                                          |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
| OS-EXT-SRV-ATTR:host                 | -                                                                        |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
| OS-EXT-SRV-ATTR:hypervisor_hostname  | -                                                                        |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
| OS-EXT-SRV-ATTR:instance_name        | instance-00000026                                                        |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
| OS-EXT-STS:power_state               | 0                                                                        |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
| OS-EXT-STS:task_state                | scheduling                                                               |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
| OS-EXT-STS:vm_state                  | building                                                                 |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
| OS-SRV-USG:launched_at               | -                                                                        |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
| OS-SRV-USG:terminated_at             | -                                                                        |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
| accessIPv4                           |                                                                          |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
| accessIPv6                           |                                                                          |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
| adminPass                            | 7ZKdcaQut7gu                                                             |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
| config_drive                         |                                                                          |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
| created                              | 2016-06-06T09:42:41Z                                                     |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
| flavor                               | m1.large (4)                                                             |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
| hostId                               |                                                                          |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
| id                                   | f1db1cce-0777-4f0e-a141-4b278c2d98b4                                     |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
| image                                | Benu-vMEG-Dev-M.0.0.0-160525-1347 (bc859dc5-103b-428b-814f-d36e59009454) |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
| key_name                             | oskey1                                                                   |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
| metadata                             | {}                                                                       |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
| name                                 | TEST                                                                     |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
| os-extended-volumes:volumes_attached | []                                                                       |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
| progress                             | 0                                                                        |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
| security_groups                      | default                                                                  |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
| status                               | BUILD                                                                    |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
| tenant_id                            | 4bc608763cee41d9a8df26d3ef919825                                         |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
| updated                              | 2016-06-06T09:42:41Z                                                     |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
| user_id                              | 266f5859848e4f39b9725203dda5c3f2                                         |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
+--------------------------------------+--------------------------------------------------------------------------+<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
[root@ localhost ~(keystone_admin)]#<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
 <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
.<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
 <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
 <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
9)<span style="font-size:7.0pt">      </span>MariaDB [nova]> select * from pci_devices;<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
+---------------------+---------------------+------------+---------+----+-----------------+--------------+------------+-----------+----------+------------------+-----------------+-----------+------------+---------------+------------+-----------+-------------+<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
| created_at          | updated_at          | deleted_at | deleted | id | compute_node_id | address      | product_id | vendor_id | dev_type | dev_id           | label           | status    | extra_info | instance_uuid | request_id | numa_node | parent_addr
 |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
+---------------------+---------------------+------------+---------+----+-----------------+--------------+------------+-----------+----------+------------------+-----------------+-----------+------------+---------------+------------+-----------+-------------+<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
| 2016-06-03 12:01:45 | 2016-06-06 09:46:35 | NULL       |       0 |  1 |               1 | 0000:83:00.0 | 0435       | 8086      | type-PF  | pci_0000_83_00_0 | label_8086_0435 | available | {}         | NULL          | NULL       |         1 | NULL       
 |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
| 2016-06-03 12:01:45 | 2016-06-06 09:46:35 | NULL       |       0 |  2 |               1 | 0000:88:00.0 | 0435       | 8086      | type-PF  | pci_0000_88_00_0 | label_8086_0435 | available | {}         | NULL          | NULL       |         1 | NULL       
 |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
+---------------------+---------------------+------------+---------+----+-----------------+--------------+------------+-----------+----------+------------------+-----------------+-----------+------------+---------------+------------+-----------+-------------+<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
2 rows in set (0.00 sec)<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
 <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
MariaDB [nova]><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
 <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
[root@localhost ~(keystone_admin)]# dmesg | grep -e DMAR -e IOMMU<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
[    0.000000] ACPI: DMAR 000000007b69a000 00130 (v01 INTEL   S2600WT 00000001 INTL 20091013)<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
[    0.128779] dmar: IOMMU 0: reg_base_addr fbffc000 ver 1:0 cap d2078c106f0466 ecap f020de<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
[    0.128785] dmar: IOMMU 1: reg_base_addr c7ffc000 ver 1:0 cap d2078c106f0466 ecap f020de<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
[    0.128911] IOAPIC id 10 under DRHD base  0xfbffc000 IOMMU 0<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
[    0.128912] IOAPIC id 8 under DRHD base  0xc7ffc000 IOMMU 1<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
[    0.128913] IOAPIC id 9 under DRHD base  0xc7ffc000 IOMMU 1<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
[root@ localhost ~(keystone_admin)]#<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
 <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
[root@localhost ~(keystone_admin)]# lscpu | grep Virtualization<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
Virtualization:        VT-x<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
[root@localhost ~(keystone_admin)]#<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
 <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
[root@localhost ~(keystone_admin)]# nova service-list<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
+----+------------------+--------+----------+---------+-------+----------------------------+-----------------+<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
| Id | Binary           | Host   | Zone     | Status  | State | Updated_at                 | Disabled Reason |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
+----+------------------+--------+----------+---------+-------+----------------------------+-----------------+<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
| 9  | nova-cert        | localhost | internal | enabled | up    | 2016-06-07T04:58:28.000000 | -               |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
| 10 | nova-consoleauth | localhost | internal | enabled | up    | 2016-06-07T04:58:30.000000 | -               |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
| 11 | nova-scheduler   | localhost | internal | enabled | up    | 2016-06-07T04:58:30.000000 | -               |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
| 12 | nova-conductor   | localhost | internal | enabled | up    | 2016-06-07T04:58:29.000000 | -               |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
| 18 | nova-compute     | localhost | nova     | enabled | up    | 2016-06-07T04:58:29.000000 | -               |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
+----+------------------+--------+----------+---------+-------+----------------------------+-----------------+<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
[root@localhost ~(keystone_admin)]#<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
 <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
 <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
[root@localhost ~(keystone_admin)]# nova host-list<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
+-----------+-------------+----------+<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
| host_name | service     | zone     |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
+-----------+-------------+----------+<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
| localhost    | cert        | internal |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
| localhost    | consoleauth | internal |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
| localhost    | scheduler   | internal |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
| localhost    | conductor   | internal |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
| localhost    | compute     | nova     |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
+-----------+-------------+----------+<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
[root@localhost ~(keystone_admin)]#<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
 <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
[root@localhost ~(keystone_admin)]#  neutron agent-list<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
+--------------------------------------+--------------------+--------+-------------------+-------+----------------+---------------------------+<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
| id                                   | agent_type         | host   | availability_zone | alive | admin_state_up | binary                    |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
+--------------------------------------+--------------------+--------+-------------------+-------+----------------+---------------------------+<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
| 0e81d20f-b41d-490a-966a-7171880963b9 | Metadata agent     | localhost |                   | :-)   | True           | neutron-metadata-agent    |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
| 2ccb17dc-35d8-41cc-8e5d-83496a7e26b0 | Metering agent     | localhost |                   | :-)   | True           | neutron-metering-agent    |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
| 6fef2fa7-2479-4d45-889c-b38b854ac3e3 | DHCP agent         | localhost | nova              | :-)   | True           | neutron-dhcp-agent        |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
| 87c976cc-e3cd-4818-aa4f-ee599bf812b1 | L3 agent           | localhost | nova              | :-)   | True           | neutron-l3-agent          |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
| aeb4f399-2281-4ad3-b880-802812910ec8 | Open vSwitch agent | localhost |                   | :-)   | True           | neutron-openvswitch-agent |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
+--------------------------------------+--------------------+--------+-------------------+-------+----------------+---------------------------+<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
[root@localhost ~(keystone_admin)]#<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
 <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
[root@localhost ~(keystone_admin)]# nova hypervisor-list<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
+----+---------------------+-------+---------+<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
| ID | Hypervisor hostname | State | Status  |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
+----+---------------------+-------+---------+<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
| 1  | localhost              | up    | enabled |<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
+----+---------------------+-------+---------+<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
[root@localhost ~(keystone_admin)]#<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
 <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
[root@localhost ~(keystone_admin)]# grep ^virt_type /etc/nova/nova.conf<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
virt_type=kvm<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
[root@localhost ~(keystone_admin)]#<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
 <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
[root@localhost ~(keystone_admin)]# grep ^compute_driver /etc/nova/nova.conf<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
compute_driver=libvirt.LibvirtDriver<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
[root@localhost ~(keystone_admin)]#<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
[root@localhost ~(keystone_admin)]#<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
 <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
Regards,<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in;background-image:initial;background-repeat:initial">
Chinmaya<o:p></o:p></p>
</div>
</div>
</body>
</html>