Open Stack

> one with baremetal GPU, one with passthrough, one with virtual GPUs on Nova directly, one with Cyborg



Agree with Sylvain Bauza, if you want to test the GPU performance you can use benchmarking, but performance may be related to the running business.

Whether it is through nova or cyborg, the GPU is bound, and there should be little difference in performance.



brinzhang

Inspur Electronic Information Industry Co.,Ltd.



发件人: Sylvain Bauza [mailto:sbauza at redhat.com]
发送时间: 2021年8月31日 23:21
收件人: Ildiko Vancsa <ildiko.vancsa at gmail.com>
抄送: OpenStack Discuss <openstack-discuss at lists.openstack.org>
主题: Re: [nova][cyborg][gpu] GPU performance testing







On Tue, Aug 31, 2021 at 5:10 PM Sylvain Bauza <sbauza at redhat.com<mailto:sbauza at redhat.com>> wrote:





   On Tue, Aug 31, 2021 at 4:34 PM Ildiko Vancsa <ildiko.vancsa at gmail.com<mailto:ildiko.vancsa at gmail.com>> wrote:

      Hi,

      As we are approaching the end of the holiday season I wanted to surface back my question about GPU performance testing. Does anyone have any hints to find the best tools to do some benchmarking with?





   You made the point, Ildiko, I was on a long-running time-off so I didn't had time to look at your question yet.



   Good concern tho, I have no knowledge about this, but I can ping a few other folks to get you an answer.



   Btw, I can understand this can be a frustrating by short answer, so I'll develop.



   Technically, benchmarking is a huge word : depending on your usecase, performance can very differ for the same card (take the general example of CPU-bound vs. IO-bound tasks and you get the idea for GPUs)

   For this reason, I'd recommend you to first consider the metrics you'd like to stress on and only then identify the tools than can sustain your needs.

   For a standard test which can be errorprone but still a bit interesting, I'd propose you to run a couple of tensorflow examples against different environments (one with baremetal GPU, one with passthrough, one with virtual GPUs on Nova directly, one with Cyborg). This would give you the idea of the performance penalities but I suspect those to be less than minor.



   For real benchmarking cases, I can't answer, hence my call to other folks. By the way, I know CERN invested a bit into HPC testing with GPUs, maybe someone from their team or someone from the related Scientific WG could provide more insights ?





   -Sylvain





   -Sylvain



      Thanks,
      Ildikó


      > On Aug 9, 2021, at 08:46, Ildiko Vancsa <ildiko.vancsa at gmail.com<mailto:ildiko.vancsa at gmail.com>> wrote:
      >
      > Hi,
      >
      > I got a question about tools and practices to check GPU performance in an OpenStack environment that I need some help to answer.
      >
      > The question is about recommended GPU performance testing/benchmarking tools if there are a few that people in the community are using and would recommend? The scope of the testing work is to check GPU performance in OpenStack VMs (both virtualized and passthrough).
      >
      > All the help and pointers are very much appreciated!
      >
      > Thanks,
      > Ildikó
      >
      >



-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-discuss/attachments/20210901/2b819ccc/attachment.html>