<html>
  <head>
    <meta content="text/html; charset=UTF-8" http-equiv="Content-Type">
  </head>
  <body text="#000000" bgcolor="#FFFFFF">
    <div class="moz-cite-prefix">Hi Reza,<br>
      Unless I missed them, I don't see any examples of error messages
      in the past messages.  What error message are you getting?  <br>
      <br>
      Are you trying to use Infiniband with Openstack?  My understanding
      is that the RDMA Infiniband stuff that OpenMPI uses currently does
      not work with virtualization -- otherwise we'd be using it :) .<br>
      <br>
      -Dave<br>
      <br>
      On 15/05/2013 7:38 AM, Reza Bakhshayeshi wrote:<br>
    </div>
    <blockquote
cite="mid:CAMGoRG1djGUV0gUv5N9jV6xqQgSGVKbd5j24NZYEUZTCPV7EhA@mail.gmail.com"
      type="cite">
      <div dir="ltr">
        <div class="gmail_default"
          style="font-family:tahoma,sans-serif;color:rgb(0,0,102)">Thank
          Lorin for your reply<br>
          <br>
        </div>
        <div class="gmail_default"
          style="font-family:tahoma,sans-serif;color:rgb(0,0,102)">
          Yes, instances are able to ping/ssh each other.<br>
        </div>
        <div class="gmail_default"
          style="font-family:tahoma,sans-serif;color:rgb(0,0,102)">I've
          used either Open MPI and MPICH, as you know, they use ssh to
          perform tasks.<br>
        </div>
        <div class="gmail_default"
          style="font-family:tahoma,sans-serif;color:rgb(0,0,102)">even
          I'm able to execute example programs, here is the output of
          mpich cpi on two instances:<br>
          <br>
          localadmin@ubuntu-benchmark01:
          <div class="gmail_default">
            ~$ mpiexec -f ./hosts2 -n 2 ./cpi<br>
            Process 0 of 2 is on ubuntu-benchmark01<br>
            Process 1 of 2 is on ubuntu-benchmark02<br>
            pi is approximately 3.1415926544231318, Error is
            0.0000000008333387<br>
            wall clock time = 0.050358<br>
            <br>
          </div>
          <div class="gmail_default">but HPCC is much more complex than
            these ones.<br>
          </div>
          <div class="gmail_default">I can perform HPCC on a single
            instance.<br>
          </div>
          <div class="gmail_default">I've setup everything similiar to
            my virtual cluster, but here I think something prevent the
            test.<br>
          </div>
          <div class="gmail_default">as soon as hpcc process start to
            execute on the second instance, it killed unexpectedly.<br>
          </div>
          <br>
        </div>
      </div>
      <div class="gmail_extra"><br>
        <br>
        <div class="gmail_quote">On 15 May 2013 17:51, Lorin Hochstein <span
            dir="ltr"><<a moz-do-not-send="true"
              href="mailto:lorin@nimbisservices.com" target="_blank">lorin@nimbisservices.com</a>></span>
          wrote:<br>
          <blockquote class="gmail_quote" style="margin:0 0 0
            .8ex;border-left:1px #ccc solid;padding-left:1ex">
            <div dir="ltr">Reza:
              <div><br>
              </div>
              <div>You should be able to run MPI programs across
                OpenStack instances as long as your setup is configured
                so that instances are allowed to communicate with each
                other over the fixed IPs, and your security group
                settings allow traffic across the ports that your MPI
                implementation is using. </div>
              <div><br>
              </div>
              <div>(OpenStack doesn't provide a distributed file system,
                so if you need to do MPI-IO stuff you have to add the
                shared file system part yourself)</div>
              <div><br>
              </div>
              <div>Are you able to ping/ssh from one instance to another
                on the fixed IPs?</div>
              <div><br>
              </div>
              <div>Lorin</div>
              <div><br>
              </div>
              <div class="gmail_extra"><br>
                <div class="gmail_quote">
                  <div>
                    <div class="h5">On Wed, May 15, 2013 at 9:08 AM,
                      Reza Bakhshayeshi <span dir="ltr"><<a
                          moz-do-not-send="true"
                          href="mailto:reza.b2008@gmail.com"
                          target="_blank">reza.b2008@gmail.com</a>></span>
                      wrote:<br>
                    </div>
                  </div>
                  <blockquote class="gmail_quote" style="margin:0 0 0
                    .8ex;border-left:1px #ccc solid;padding-left:1ex">
                    <div>
                      <div class="h5">
                        <div dir="ltr">
                          <div
                            style="font-family:tahoma,sans-serif;color:rgb(0,0,102)">Hi
                            <br>
                            <br>
                          </div>
                          <div
                            style="font-family:tahoma,sans-serif;color:rgb(0,0,102)">
                            I want to perform a MPI program across the
                            instances. I've already done it on a
                            traditional and virtual cluster, so I'm
                            pretty sure about the healthiness of my
                            installation.<br>
                          </div>
                          <div
                            style="font-family:tahoma,sans-serif;color:rgb(0,0,102)">Unfortunately
                            I can't perform it on a cluster of OpenStack
                            instances.<br>
                          </div>
                          <div
                            style="font-family:tahoma,sans-serif;color:rgb(0,0,102)">
                            My MPI program is HPCC, it stops at the
                            begging of MPIRandomAccess.<br>
                            <br>
                          </div>
                          <div
                            style="font-family:tahoma,sans-serif;color:rgb(0,0,102)">I
                            would be so grateful if anyone had a similar
                            experience or can guess some possibilities
                            and solutions.<br>
                            <br>
                          </div>
                          <div
                            style="font-family:tahoma,sans-serif;color:rgb(0,0,102)">Regards,<br>
                          </div>
                          <div
                            style="font-family:tahoma,sans-serif;color:rgb(0,0,102)">Reza<br>
                          </div>
                        </div>
                        <br>
                      </div>
                    </div>
                    _______________________________________________<br>
                    OpenStack-operators mailing list<br>
                    <a moz-do-not-send="true"
                      href="mailto:OpenStack-operators@lists.openstack.org"
                      target="_blank">OpenStack-operators@lists.openstack.org</a><br>
                    <a moz-do-not-send="true"
href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators"
                      target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators</a><br>
                    <br>
                  </blockquote>
                </div>
                <span class="HOEnZb"><font color="#888888"><br>
                    <br clear="all">
                    <div><br>
                    </div>
                    -- <br>
                    <div dir="ltr">Lorin Hochstein<br>
                      <div>Lead Architect - Cloud Services</div>
                      <div>Nimbis Services, Inc.</div>
                      <div>
                        <a moz-do-not-send="true"
                          href="http://www.nimbisservices.com"
                          target="_blank">www.nimbisservices.com</a></div>
                    </div>
                  </font></span></div>
            </div>
          </blockquote>
        </div>
        <br>
      </div>
    </blockquote>
    <br>
  </body>
</html>