<html xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=gb2312">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
        {font-family:"MS Gothic";
        panose-1:2 11 6 9 7 2 5 8 2 4;}
@font-face
        {font-family:"Cambria Math";
        panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
        {font-family:Calibri;
        panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
        {font-family:"Microsoft YaHei";
        panose-1:2 11 5 3 2 2 4 2 2 4;}
@font-face
        {font-family:"\@MS Gothic";
        panose-1:2 11 6 9 7 2 5 8 2 4;}
@font-face
        {font-family:"\@Microsoft YaHei";}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
        {margin:0cm;
        font-size:10.0pt;
        font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
        {mso-style-priority:99;
        color:blue;
        text-decoration:underline;}
span.EmailStyle20
        {mso-style-type:personal-reply;
        font-family:"Calibri",sans-serif;
        color:windowtext;}
.MsoChpDefault
        {mso-style-type:export-only;
        font-size:10.0pt;
        mso-ligatures:none;}
@page WordSection1
        {size:612.0pt 792.0pt;
        margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
        {page:WordSection1;}
--></style>
</head>
<body lang="EN-AU" link="blue" vlink="purple" style="word-wrap:break-word">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;mso-fareast-language:EN-US">Ah thank you for pointing me towards that Alex.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;mso-fareast-language:EN-US">I guess, I should probably look at the MIG pathway.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;mso-fareast-language:EN-US">I wonder if it’s possible to do vGPU profiles in MIG configuration.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;mso-fareast-language:EN-US">Have you any experience with this?<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;mso-fareast-language:EN-US">Thanks,<br>
Karl.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<div id="mail-editor-reference-message-container">
<div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal" style="margin-bottom:12.0pt"><b><span style="font-size:12.0pt;color:black;mso-fareast-language:ZH-CN">From:
</span></b><span style="font-size:12.0pt;color:black;mso-fareast-language:ZH-CN">Alex Song (</span><span lang="ZH-CN" style="font-size:12.0pt;font-family:"MS Gothic";color:black;mso-fareast-language:ZH-CN">宋文平</span><span style="font-size:12.0pt;color:black;mso-fareast-language:ZH-CN">)
 <songwenping@inspur.com><br>
<b>Date: </b>Friday, 22 September 2023 at 12:17 pm<br>
<b>To: </b>Karl Kloppenborg <kkloppenborg@resetdata.com.au>, sbauza@redhat.com <sbauza@redhat.com><br>
<b>Cc: </b>openstack-discuss@lists.openstack.org <openstack-discuss@lists.openstack.org><br>
<b>Subject: </b></span><span lang="ZH-CN" style="font-size:12.0pt;font-family:"MS Gothic";color:black;mso-fareast-language:ZH-CN">答复</span><span style="font-size:12.0pt;color:black;mso-fareast-language:ZH-CN">: Cyborg nova reports mdev-capable resource is not
 available<o:p></o:p></span></p>
</div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;color:#1F497D;mso-fareast-language:ZH-CN"> </span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;color:#1F497D;mso-fareast-language:ZH-CN">Hi Karl,</span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;color:#1F497D;mso-fareast-language:ZH-CN">         Your problem is similar with the bug:</span><span lang="EN-US" style="mso-fareast-language:ZH-CN">
</span><span lang="EN-US" style="font-size:10.5pt;color:#1F497D;mso-fareast-language:ZH-CN"><a href="https://bugs.launchpad.net/nova/+bug/2015892">https://bugs.launchpad.net/nova/+bug/2015892</a></span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;color:#1F497D;mso-fareast-language:ZH-CN">         I guess you don’t split the mig if using A serial card.</span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;color:#1F497D;mso-fareast-language:ZH-CN"> </span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b><span lang="ZH-CN" style="font-size:11.0pt;font-family:"Microsoft YaHei",sans-serif;mso-fareast-language:ZH-CN">发件人</span></b><b><span lang="EN-US" style="font-size:11.0pt;font-family:"Microsoft YaHei",sans-serif;mso-fareast-language:ZH-CN">:</span></b><span lang="EN-US" style="font-size:11.0pt;font-family:"Microsoft YaHei",sans-serif;mso-fareast-language:ZH-CN">
 Karl Kloppenborg [mailto:kkloppenborg@resetdata.com.au] <br>
</span><b><span lang="ZH-CN" style="font-size:11.0pt;font-family:"Microsoft YaHei",sans-serif;mso-fareast-language:ZH-CN">发送时间</span></b><b><span lang="EN-US" style="font-size:11.0pt;font-family:"Microsoft YaHei",sans-serif;mso-fareast-language:ZH-CN">:</span></b><span lang="EN-US" style="font-size:11.0pt;font-family:"Microsoft YaHei",sans-serif;mso-fareast-language:ZH-CN">
 2023</span><span lang="ZH-CN" style="font-size:11.0pt;font-family:"Microsoft YaHei",sans-serif;mso-fareast-language:ZH-CN">年</span><span lang="EN-US" style="font-size:11.0pt;font-family:"Microsoft YaHei",sans-serif;mso-fareast-language:ZH-CN">9</span><span lang="ZH-CN" style="font-size:11.0pt;font-family:"Microsoft YaHei",sans-serif;mso-fareast-language:ZH-CN">月</span><span lang="EN-US" style="font-size:11.0pt;font-family:"Microsoft YaHei",sans-serif;mso-fareast-language:ZH-CN">22</span><span lang="ZH-CN" style="font-size:11.0pt;font-family:"Microsoft YaHei",sans-serif;mso-fareast-language:ZH-CN">日</span><span lang="EN-US" style="font-size:11.0pt;font-family:"Microsoft YaHei",sans-serif;mso-fareast-language:ZH-CN">
 0:43<br>
</span><b><span lang="ZH-CN" style="font-size:11.0pt;font-family:"Microsoft YaHei",sans-serif;mso-fareast-language:ZH-CN">收件人</span></b><b><span lang="EN-US" style="font-size:11.0pt;font-family:"Microsoft YaHei",sans-serif;mso-fareast-language:ZH-CN">:</span></b><span lang="EN-US" style="font-size:11.0pt;font-family:"Microsoft YaHei",sans-serif;mso-fareast-language:ZH-CN">
 Sylvain Bauza <sbauza@redhat.com><br>
</span><b><span lang="ZH-CN" style="font-size:11.0pt;font-family:"Microsoft YaHei",sans-serif;mso-fareast-language:ZH-CN">抄送</span></b><b><span lang="EN-US" style="font-size:11.0pt;font-family:"Microsoft YaHei",sans-serif;mso-fareast-language:ZH-CN">:</span></b><span lang="EN-US" style="font-size:11.0pt;font-family:"Microsoft YaHei",sans-serif;mso-fareast-language:ZH-CN">
 openstack-discuss@lists.openstack.org<br>
</span><b><span lang="ZH-CN" style="font-size:11.0pt;font-family:"Microsoft YaHei",sans-serif;mso-fareast-language:ZH-CN">主题</span></b><b><span lang="EN-US" style="font-size:11.0pt;font-family:"Microsoft YaHei",sans-serif;mso-fareast-language:ZH-CN">:</span></b><span lang="EN-US" style="font-size:11.0pt;font-family:"Microsoft YaHei",sans-serif;mso-fareast-language:ZH-CN">
 Re: Cyborg nova reports mdev-capable resource is not available</span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:ZH-CN"> </span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;mso-fareast-language:EN-US">Hi Sylvian,</span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;mso-fareast-language:EN-US"> </span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;mso-fareast-language:EN-US">Thanks for getting back to me.</span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;mso-fareast-language:EN-US">So the vGPU is available and cyborg is allocating it using ARQ binding.</span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;mso-fareast-language:EN-US">You can see Nova receives this request:</span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;mso-fareast-language:EN-US"> </span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;mso-fareast-language:EN-US">2023-09-21 16:38:51.889 1901814 DEBUG nova.compute.manager [None req-97062e9c-0c44-480e-9918-4a5a810175b2 78e83e5a446e4071ae43e823135dcb3c 21eb701c2a1f48b38dab8f34c0a20902 - - default
 default] ARQs for spec:{'2d60c353-0419-4b67-8cb7-913fc6f5cef9': {'uuid': '2d60c353-0419-4b67-8cb7-913fc6f5cef9', 'state': 'Bound', 'device_profile_name': 'VGPU_A40-Q48', 'device_profile_group_id': 0, 'hostname': 'gpu-c-01', 'device_rp_uuid': '229bf15f-5689-3d2c-b37b-5c8439ea6a71',
 'instance_uuid': '1b090007-791b-4997-af89-0feb886cf11d', 'project_id': None, 'attach_handle_type': 'MDEV', 'attach_handle_uuid': '866bd6a5-b156-4251-a969-64fefb32f16f', 'attach_handle_info': {'asked_type': 'nvidia-566', 'bus': 'ca', 'device': '01', 'domain':
 '0000', 'function': '1', 'vgpu_mark': 'nvidia-566_0'}, 'links': [{'href': 'http://cyborg-api.openstack.svc.cluster.local:6666/accelerator/v2/accelerator_requests/2d60c353-0419-4b67-8cb7-913fc6f5cef9', 'rel': 'self'}], 'created_at': '2023-09-21T16:38:42+00:00',
 'updated_at': '2023-09-21T16:38:42+00:00'}}, ARQs for network:{} _build_resources /var/lib/openstack/lib/python3.10/site-packages/nova/compute/manager.py:2680</span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;mso-fareast-language:EN-US"> </span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;mso-fareast-language:EN-US">So the mdev is then allocated in the resource providers at that point.</span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;mso-fareast-language:EN-US"> </span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;mso-fareast-language:EN-US">Is there some cyborg nova patching code I am missing?</span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;mso-fareast-language:EN-US"> </span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;mso-fareast-language:EN-US"> </span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;mso-fareast-language:EN-US"> </span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;mso-fareast-language:EN-US"> </span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<div id="mail-editor-reference-message-container">
<div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal" style="margin-bottom:12.0pt"><b><span style="font-size:12.0pt;color:black;mso-fareast-language:ZH-CN">From:
</span></b><span style="font-size:12.0pt;color:black;mso-fareast-language:ZH-CN">Sylvain Bauza <</span><span lang="EN-US" style="mso-fareast-language:ZH-CN"><a href="mailto:sbauza@redhat.com"><span lang="EN-GB" style="font-size:12.0pt"><span lang="EN-GB">sbauza@redhat.com</span></span></a></span><span style="font-size:12.0pt;color:black;mso-fareast-language:ZH-CN">><br>
<b>Date: </b>Friday, 22 September 2023 at 1:49 am<br>
<b>To: </b>Karl Kloppenborg <</span><span lang="EN-US" style="mso-fareast-language:ZH-CN"><a href="mailto:kkloppenborg@resetdata.com.au"><span lang="EN-GB" style="font-size:12.0pt"><span lang="EN-GB">kkloppenborg@resetdata.com.au</span></span></a></span><span style="font-size:12.0pt;color:black;mso-fareast-language:ZH-CN">><br>
<b>Cc: </b></span><span lang="EN-US" style="mso-fareast-language:ZH-CN"><a href="mailto:openstack-discuss@lists.openstack.org"><span lang="EN-GB" style="font-size:12.0pt"><span lang="EN-GB">openstack-discuss@lists.openstack.org</span></span></a></span><span style="font-size:12.0pt;color:black;mso-fareast-language:ZH-CN">
 <</span><span lang="EN-US" style="mso-fareast-language:ZH-CN"><a href="mailto:openstack-discuss@lists.openstack.org"><span lang="EN-GB" style="font-size:12.0pt"><span lang="EN-GB">openstack-discuss@lists.openstack.org</span></span></a></span><span style="font-size:12.0pt;color:black;mso-fareast-language:ZH-CN">><br>
<b>Subject: </b>Re: Cyborg nova reports mdev-capable resource is not available</span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
</div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;mso-fareast-language:ZH-CN"> </span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
</div>
<p class="MsoNormal"><span style="font-size:11.0pt;mso-fareast-language:ZH-CN"> </span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;mso-fareast-language:ZH-CN">Le jeu. 21 sept. 2023 à 17:27, Karl Kloppenborg <</span><span lang="EN-US" style="mso-fareast-language:ZH-CN"><a href="mailto:kkloppenborg@resetdata.com.au"><span lang="EN-GB" style="font-size:11.0pt"><span lang="EN-GB">kkloppenborg@resetdata.com.au</span></span></a></span><span style="font-size:11.0pt;mso-fareast-language:ZH-CN">>
 a écrit :</span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
</div>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0cm;margin-bottom:5.0pt">
<div>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;color:#1D1D1D;mso-fareast-language:ZH-CN">Hi Cyborg Team!</span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;color:#1D1D1D;mso-fareast-language:ZH-CN">Karl from Helm Team.</span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;color:#1D1D1D;mso-fareast-language:ZH-CN"> </span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;color:#1D1D1D;mso-fareast-language:ZH-CN">When creating a VM with the correct flavor, the mdev gets created by cyborg agent and I can see it in the
 nodedev-list --cap mdev.</span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;color:#1D1D1D;mso-fareast-language:ZH-CN">However Nova then fails with:</span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;color:#1D1D1D;mso-fareast-language:ZH-CN">nova.virt.libvirt.driver [<removed>- - default default] Searching for available mdevs... _get_existing_mdevs_not_assigned
 /var/lib/openstack/lib/python3.10/site-packages/nova/virt/libvirt/driver.py</span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;color:#1D1D1D;mso-fareast-language:ZH-CN">:8357</span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;color:#1D1D1D;mso-fareast-language:ZH-CN">2023-09-21 14:34:47.808 1901814 INFO nova.virt.libvirt.driver [<removed> - - default default] Available mdevs
 at: set().</span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;color:#1D1D1D;mso-fareast-language:ZH-CN">2023-09-21 14:34:47.809 1901814 DEBUG nova.virt.libvirt.driver [<removed> - - default default] No available
 mdevs where found. Creating an new one... _allocate_mdevs /var/lib/openstack/lib/python3.10/site-packages/nova/virt/libvirt/driv</span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;color:#1D1D1D;mso-fareast-language:ZH-CN">er.py:8496</span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;color:#1D1D1D;mso-fareast-language:ZH-CN">2023-09-21 14:34:47.809 1901814 DEBUG nova.virt.libvirt.driver [<removed> - - default default] Attempting
 to create new mdev... _create_new_mediated_device /var/lib/openstack/lib/python3.10/site-packages/nova/virt/libvirt/driver.py:8385</span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;color:#1D1D1D;mso-fareast-language:ZH-CN">2023-09-21 14:34:48.455 1901814 INFO nova.virt.libvirt.driver [<removed> - - default default] Failed to create
 mdev. No free space found among the following devices: ['pci_0000_4b_03_1', … <truncated list>].</span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;color:#1D1D1D;mso-fareast-language:ZH-CN">2023-09-21 14:34:48.456 1901814 ERROR nova.compute.manager [<removed> - - default default] [instance: 2026e2a2-b17a-43ab-adcb-62a907f58b51]
 Instance failed to spawn: nova.exception.ComputeResourcesUnavailable: Insufficient compute resources: mdev-capable resource is not available.</span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;color:#1D1D1D;mso-fareast-language:ZH-CN"> </span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
</div>
</div>
</div>
</blockquote>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;mso-fareast-language:ZH-CN"> </span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;mso-fareast-language:ZH-CN">I don't exactly remember how Cyborg passes the devices to nova/libvirt but this exception is because none of the available GPUs have either existing mdevs or capability for creating
 mdevs.</span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;mso-fareast-language:ZH-CN">You should first check sysfs to double-check the state of our GPU devices in order to understand how much of vGPU capacity you still have.
</span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;mso-fareast-language:ZH-CN"> </span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;mso-fareast-language:ZH-CN">-Sylvain</span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;mso-fareast-language:ZH-CN"> </span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
</div>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0cm;margin-bottom:5.0pt">
<div>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;color:#1D1D1D;mso-fareast-language:ZH-CN">Once this happened, ARQ removes the mdev and cleans up.</span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;color:#1D1D1D;mso-fareast-language:ZH-CN"> </span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;color:#1D1D1D;mso-fareast-language:ZH-CN">I’ve got Cyborg 2023.2 running and have a device profile like so:</span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;color:#1D1D1D;mso-fareast-language:ZH-CN">karl@Karls-Air ~ % openstack accelerator device profile show e2b07e11-fe69-4f33-83fc-0f9e38adb7ae</span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;color:#1D1D1D;mso-fareast-language:ZH-CN">+-------------+---------------------------------------------------------------------------+</span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;color:#1D1D1D;mso-fareast-language:ZH-CN">| Field       | Value                                                                     |</span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;color:#1D1D1D;mso-fareast-language:ZH-CN">+-------------+---------------------------------------------------------------------------+</span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;color:#1D1D1D;mso-fareast-language:ZH-CN">| created_at  | 2023-09-21 13:30:05+00:00                                                 |</span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;color:#1D1D1D;mso-fareast-language:ZH-CN">| updated_at  | None                                                                      |</span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;color:#1D1D1D;mso-fareast-language:ZH-CN">| uuid        | e2b07e11-fe69-4f33-83fc-0f9e38adb7ae                                      |</span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;color:#1D1D1D;mso-fareast-language:ZH-CN">| name        | VGPU_A40-Q48                                                              |</span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;color:#1D1D1D;mso-fareast-language:ZH-CN">| groups      | [{'resources:VGPU': '1', 'trait:CUSTOM_NVIDIA_2235_A40_48Q': 'required'}] |</span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;color:#1D1D1D;mso-fareast-language:ZH-CN">| description | None                                                                      |</span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;color:#1D1D1D;mso-fareast-language:ZH-CN">+-------------+---------------------------------------------------------------------------+</span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;color:#1D1D1D;mso-fareast-language:ZH-CN">karl@Karls-Air ~ %</span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;color:#1D1D1D;mso-fareast-language:ZH-CN"> </span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;color:#1D1D1D;mso-fareast-language:ZH-CN">I can see the allocation candidate:</span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;color:#1D1D1D;mso-fareast-language:ZH-CN">karl@Karls-Air ~ % openstack allocation candidate list --resource VGPU=1 | grep A40</span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;color:#1D1D1D;mso-fareast-language:ZH-CN">|  41 | VGPU=1     | 229bf15f-5689-3d2c-b37b-5c8439ea6a71 | VGPU=0/1                | OWNER_CYBORG,CUSTOM_NVIDIA_2235_A40_48Q
 |</span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;color:#1D1D1D;mso-fareast-language:ZH-CN">karl@Karls-Air ~ %</span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;color:#1D1D1D;mso-fareast-language:ZH-CN"> </span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;color:#1D1D1D;mso-fareast-language:ZH-CN"> </span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;color:#1D1D1D;mso-fareast-language:ZH-CN">Am I missing something critical here? Because I cannot seem to figure this out… have I got a PCI address
 wrong, or something?</span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;color:#1D1D1D;mso-fareast-language:ZH-CN"> </span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;color:#1D1D1D;mso-fareast-language:ZH-CN">Any help from the Cyborg or Nova teams would be fantastic.</span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;color:#1D1D1D;mso-fareast-language:ZH-CN"> </span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;color:#1D1D1D;mso-fareast-language:ZH-CN">Thanks,<br>
Karl.</span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;mso-fareast-language:ZH-CN"> </span><span style="mso-fareast-language:ZH-CN"><o:p></o:p></span></p>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</body>
</html>