- OpenStack-HPC - lists.openstack.org

Fake Conferences CSCI and WORLDCOMP of Hamid Arabnia
by hailybrown＠hushmail.com 30 Jan '14

30 Jan '14

Fake Conferences CSCI and WORLDCOMP of Hamid Arabnia If you have any thought of attending the world’s biggest fake conference in computer science, WORLDCOMP http://www.world-academy-of-science.org you must visit any websites below https://sites.google.com/site/worlddump1 or https://sites.google.com/site/dumpconf https://sites.google.com/site/moneycomp1 https://sites.google.com/site/worlddump4 The organizer of this conference is Hamid Arabnia http://www.cs.uga.edu/~hra a professor from University of Georgia, Athens, US. The primary goal of this conference is to collect registration fee by accepting all submitted papers. Several fake papers were published in the conference proceedings. He already earned millions of dollars from the registration fee and is using part of the money for anti-Christmas greetings campaign. http://worldcomp-fake-bogus.blogspot.com has additional information on this campaign. He recently started another new conference CSCI due to his hunger for money http://www.americancse.org Hamid Arabnia failed to reveal the reviews and reviewers' information for all the papers he received, despite repeated requests and challenges. The reason for his failure is there were no reviews and reviewers and he just cheated the research community for more than a decade by announcing that each draft paper is reviewed by two experts. We challenge him to publish these details at the conference website. Where are these experts? Where are these reviews? Soon he comes up with a story that he lost all the reviews and reviewers’ information because of computer crash or theft. DBLP stopped indexing these conferences since 2011 and displayed an explicit message; The DBLP Advisory Board decided to discontinue indexing of this conference series. Visit http://www.informatik.uni-trier.de/~ley/db/conf/biocomp/index.html as a sample. He was forced to remove his name, the university of Georgia name, and university of Georgia email address from the conference’s contact page because the University has banned him from doing that. Do not spoil your resume by publishing in this bogus conference. Wikipedia’s comments on Hamid Arabnia are at http://en.wikipedia.org/w/index.php?title=Talk:Hamid_Arabnia&oldid Additional information on this conference bogus conference is available by searching internet using the keywords worldcomp fake or Hamid Arabnia fake Apologies for posting to multiple mailing lists. Spreading the news is the only way to stop this conference from harming innocent researchers. Respectfully, Many researchers cheated by Hamid Arabnia’s fake conferences

1 0

Data management
by Theodore Omtzigt 12 Dec '13

12 Dec '13

We are working on an OpenStack-based HPC on-demand service, but run into data management problems. We are working in the context of a hybrid cloud configuration, tailored to collaborative HPC, and are looking for similar minded folks and projects, to solve data management, and in particular data migration services for said hybrid clouds. Theo Stillwater Supercomputing, Inc. "/Accelerating Innovation"/

4 3

Testing
by Dave Ojika 12 Dec '13

12 Dec '13

Testing: checking to see if list works. No mail has hit my inbox yet. I am excited about openstack for HPC.

3 3

FW: Internet2 + HPC
by Dave Ojika 06 Dec '13

06 Dec '13

> I am a Ph.D student at university of florida with research interest in > HPC and multi-core systems. I am wondering how I can explore more > about openstack in the area of high-performance computing in order to > possibly kick start research. -----Original Message----- From: Stefano Maffulli [mailto:stefano@openstack.org] Sent: Friday, December 06, 2013 5:38 PM To: Dave Ojika Subject: Re: Internet2 + HPC Hi Dave, you wrote to the owner of the list. I'd suggest you to write to the list itself: openstack-hpc(a)lists.openstack.org Cheers, stef On Fri 06 Dec 2013 12:24:09 AM PST, Dave Ojika wrote: > I am a Ph.D student at university of florida with research interest in > HPC and multi-core systems. I am wondering how I can explore more > about openstack in the area of high-performance computing in order to > possibly kick start research in this area for my independent study > after I discuss with my advisor. thank you -- Ask and answer questions on https://ask.openstack.org

1 0

Vote now for speakers
by John Paul Walters 07 Nov '13

07 Nov '13

Hi folks, We have submitted for two speaking slots in the upcoming design summit summit. Now is the time to vote for them, if it's something that you're interested in. The first link, is a overview of the state of the art in HPC within OpenStack, featuring Tim Bell, Gegor von Laszewski, Patrick Petit, and myself. http://www.openstack.org/rate/Presentation/technical-computing-with-opensta… The second is a technical discussion about VM access to devices like GPUs and Infiniband interfaces featuring Andrew Younge, a visiting researcher at ISI. http://www.openstack.org/rate/Presentation/building-high-performance-clouds… Voting ends Aug. 25. Please consider voting for these so that HPC is well represented at the Hong Kong summit. best, JP

8 23

Fwd: Re: [openstack-dev] GPU passthrough support blueprints for OpenStack
by Brian Schott 16 Aug '13

16 Aug '13

Don't know if you caught this on the main dev list. — Sent from Mailbox for iPhone ---------- Forwarded message ---------- From: "Brian Schott" <brian.schott(a)nimbisservices.com> Date: Wed, Aug 14, 2013 at 9:53 AM Subject: Re: [openstack-dev] GPU passthrough support blueprints for OpenStack To: "OpenStack Development Mailing List" <openstack-dev(a)lists.openstack.org> > Thanks for the pointers. I'll try to work with the UCS-ISI team that currently maintains those stories and see if we can reconcile or close the old blueprints. > ------------------------------------------------- > Brian Schott, CTO > Nimbis Services, Inc. > brian.schott(a)nimbisservices.com > ph: 443-274-6064 fx: 443-274-6060 > On Aug 14, 2013, at 6:03 AM, Bob Ball <bob.ball(a)citrix.com> wrote: >> Hi Brian, >> >> Instead of specific GPU pass-through there are blueprints for generic PCI pass through at https://blueprints.launchpad.net/nova/+spec/pci-passthrough-base - these are being worked on for Havana and we're hopeful they will get in (possibly libvirt only) >> >> In terms of vGPU rather than whole-GPU pass through, the slides are correct that XenServer support is very nearly here: http://www.xenserver.org/discuss-virtualization/q-and-a/nvidia-vgpu-on-xens… >> >> Support for static allocation of vGPU is likely going to be the first phase - and adding it as a resource similar to RAM/CPU isn't likely to be proposed until a second phase. >> >> As such, I think the integration should be very similar to PCI pass through above. >> >> >> Bob >> >>> -----Original Message----- >>> From: Brian Schott [mailto:brian.schott@nimbisservices.com] >>> Sent: 13 August 2013 23:07 >>> To: openstack-dev(a)lists.openstack.org >>> Subject: [openstack-dev] GPU passthrough support blueprints for OpenStack >>> >>> Are there more recent blueprints related to adding GPU pass-through >>> support? All that I can find are some stale blueprints that I created around >>> the Cactus timeframe (while wearing a different hat) that are pretty out of >>> date. >>> >>> I just heard a rumor that folks are doing Nvidia GRID K2 GPU passthrough >>> with KVM successfully using linux 3.10.6 kernel with RHEL. >>> >>> In addition, Lorin and I did some GPU passthrough testing back in the spring >>> with GRID K2 on HyperV, libvirt+xen, and XenServer. Slides are here: >>> http://www.slideshare.net/bfschott/nimbis-schott- >>> openstackgpustatus20130618 >>> >>> The virtualization support for GPU-enabled virtual desktops and GPGPU >>> seems to have stabilized this year for server deployments. How is this going >>> to be supported in OpenStack? >>> >>> Brian >>> >>> ------------------------------------------------- >>> Brian Schott, CTO >>> Nimbis Services, Inc. >>> brian.schott(a)nimbisservices.com >>> ph: 443-274-6064 fx: 443-274-6060 >>> >>> >> >> >> _______________________________________________ >> OpenStack-dev mailing list >> OpenStack-dev(a)lists.openstack.org >> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

1 0

Looking for practical Openstack + Ceph guidance for shared HPC
by Joshua Dotson 29 Jul '13

29 Jul '13

Hello. A contingent of my organization, the Kno.e.sis Center @ Wright State University <http://www.knoesis.org/>, recently received a grant award which we intend to use to support a handful of mid-size HPC-style workloads (MPI <-- definitely, GPGPU <-- if possible/plausible) in addition to many mid-size IaaS-style workloads (MongoDB, Storm, Hadoop, many others). As a third layer, I'm playing with the idea of evaluating an elastic OpenShift Origin atop the same infrastructure. Approximately $400k to $500k will hopefully be available for this deployment, though exact numbers are not yet available to me. While I'm prepared to build a home-grown small-to-mid-size "classical" HPC, using modern hardware, and a smaller silo for home-grown Openstack for the minority stakeholders, I am hoping to find ways of making proponents of both workloads simultaneously happy, or close to it. That is, I would like to give my computer scientist users a friendly method of running their HPC-style jobs on a combined performance-tuned silo of Openstack. Doing so would load-balance the procured hardware and infrastructure with the users who want a Tomcat or a Virtuoso instance. I see a number of serious issues realizing such a goal. For example, the state of Infiniband vs. Openstack seems not quite ready/available/documented/accessible for such use in production, unless I'm just blind to the right blogs. The added myriad abstractions and latency virtualization might impose on an HPC task, not to mention cloud software defined networking (Quantum, especially when sans hardware acceleration), seem likely to really get in the way of practicality, economics and efficiency. That said, most of what we do here isn't HPC, so I believe such trade-offs can be agreed upon, if a reasonable job scheduling and workload management mechanism can be found and agreed upon by all stake holders, grant proposal majority (HPC) and minority (IaaS) alike. I get the impression from my readings that HPC-style deployment (separate from job queuing) against the EC2 API should work. I don't have a good feeling that the experience would be particularly friendly, however, without paying for closed source applications. I'm thinking a high-performance Ceph install would help bring up the storage end of things in a modern open-source CoTS way. I've not done specific research on Lustre + Openstack, but no reports of such a setup have presented themselves to me, either. These blue sky ideas matter nil, it seems, if a sufficiently-large high-performance production-quality Openstack deployment is beyond the funds to be allotted, which is something else I'm working on. I've built smallish but useful virt-manager, oVirt and Openstack environments here already, but none of them are enough for the very-important HPC job proposed for this grant. The scientist running the proposed computation gave me following information to clarify what would parity (for his job only) his experience running the computation with an external HPC service provider. - MPI - 20 Gbps Infiniband compute interconnect - 600 cores (those currently used are probably G4 Opteron 2.4 Ghz) - 4 GB RAM per core - at lest 2 TB shared storage, though I'm thinking we need much more for use by our general community - unsure of the storage networking topology We're in the shopping phase for this grant award and are still playing with ideas. It seems likely to snap back into an old-school HPC, at this time. I've fielded communication about our needs to a number of Openstack and hardware providers, on the hope that they can bring something helpful to the table. Please let know if you can point me in the right direction(s). I'm up to reading whatever text is thrown at me on this topic. :-) Thanks, Joshua -- Joshua M. Dotson Systems Administrator Kno.e.sis Center Wright State University - Dayton, OH

8 13

Re: [openstack-hpc] Looking for OpenStack workload management
by Tim Bell 26 Jul '13

26 Jul '13

At CERN, we have similar interests and aims as you describe. We're running LSF on top of the cloud to allow legacy batch applications to use cloud resources as well as those who are talking directly to the cloud APIs. To track resources, we are setting up a dedicated batch project in OpenStack. These resources are accounted to the IT department. We then use the batch system accounting records to work out who has used what resources inside the 'virtual batch' system. We've also been experimenting with submitting batch accounting records into ceilometer in order to consolidate the reporting into a single technology. Where we are trying to find a good solution is regarding how to use spot market resources in our cloud. If we allocate out a quota to a project but they do not use the full resources, we want to be able to offer that quota to others on a low SLA (killed with little warning). This allows us to get our resource utilisation up while ensuring that projects can get the resources they're entitled to when there is a need. This is an interesting area to be getting a few sites together to share solutions. Tim From: Di Pe [mailto:dipeit@gmail.com] Sent: 26 July 2013 08:48 To: openstack-hpc(a)lists.openstack.org Subject: Re: [openstack-hpc] Looking for practical Openstack + Ceph guidance for shared HPC All, one issue Joshua touched on was options for workload management. While IB and GPU seem to frequently discussed when it comes to openstack and HPC they are not so relevant in our HPC environment (3000 ish cores, each node connected via 1G, scaleout NAS storage, biomedical research, genomics, proteomics, statistics) ..... many other midsize shops may be have similar setups. We are just starting to look at openstack for a for a potential deployment with Ubuntu 14.04. We have good experiences using KVM for some of our resources. Some of the things we are hoping to get from openstack in the future are: * flexible partitioning of resources for special sauce software (hadoop, interactive HPC software) * self service for developers and scientists * allow research group that spans multiple research organizations (internal / external) controlled access to an isolated (virtual) datacenter (potentially with fisma compliance) * save images that researchers built for later use (reproducible in case someone asks how they got to this result) * chargeback for HPC resources for internal and external users * usage of idle resources for testing in Enterprise IT, VDI ,etc * compute fencing (as we are heading to 24 cores per box most of our multi threaded code can still only take advantage of 4-6 cores. This either leaves stuff idle or users step on each other on shared nodes ....cgroups is a bit of a pain to maintain. * checkpointing and restarting long running jobs (for prioritization and better protection against job failures). perhaps LXC containers as alternative to KVM (we use BLCR today but that community is quite small) * standardization of our infrastructure * potential participation in futuregrid, XSEDE, etc That's perhaps a lot to ask but we would be looking at a 2-3 year time frame. What I don't quite unterstand, how would one handle workload management. Currently we see people using SGE, moab, LSF and some slurm in classic HPC. Concepts like backfill, preemption fair share and such things are probably unknown to openstack? If so it would perhaps be acceptable to run a workload manager on a subset of always-on KVM systems or even baremetal for classic HPC. But how does one consolidate the reporting, billing, chargeback of 2 separate systems? Are there any efforts to integrate workload managers directly into nova? SGE and Slurm are both open source and would support everything we require. Or are folks thinking about writing something from scratch in python? Thanks dipe On Thu, Jul 25, 2013 at 6:22 PM, Narayan Desai <narayan.desai(a)gmail.com <mailto:narayan.desai@gmail.com> > wrote: Brian's right. You will end up doing a lot of work; nova isn't ready for this out of the box. The key problems are: - drivers for virtualization (either via SR-IOV or device passthrough) for net + gpu - IO architecture There is apparently SR-IOV support for IB, provided that you have the right hardware, firmware, and driver, though I haven't managed to make it work. This provides a pkey isolated multi-tenant environment. THat is basically a mellanox only solution. Like Brian said, Xen is the only way to go for GPU virtualization. You can do some really interesting things with the I/O architecture. We've been experimenting with both glusterfs and ceph. Both seem to perform decently well; we've managed to get the glusterfs setup going at 60 GB/s in aggregate with a pile of clients. There isn't good integration of all of the capabilities yet in mainline openstack, but this looks promising. Ceph looks like the mainline integration is better, but we haven't tried those things out yet. At the end of the day, you need to ask yourself why you want to accomplish this. If you're running a workload that is well suited to an HPC cluster, you should probably use one. If you need multi-tenancy, user control of system software, or need to run a workload poorly suited for a traditional cluster, then it is worth thinking strongly about. You'll end up needing to do a bunch of work though. In our case, the reason that we pursued this course is because we have workloads and developers that benefit from the cloud control plane. hth. -nld On Thu, Jul 25, 2013 at 3:30 PM, Brian Schott <brian.schott(a)nimbisservices.com <mailto:brian.schott@nimbisservices.com> > wrote: Joshua, It is something those of us working the gap between HPC and cloud have struggled with. We lack a strong project team within OpenStack IMHO, although there are several small groups doing HPC with OpenStack. Hopefully others will chime in on some other topics, such as Infiniband support, but we did some testing with a GRID K2 card for GPU pass-through with different hypervisors. A talk I gave at the OpenStack DC meetup is here: http://www.slideshare.net/bfschott/nimbis-schott-openstackgpustatus20130618 The short GPU answer is that it is possible with Xen, XenCenter, and XCP to passthrough GPUs today, but OpenStack doesn't have support by default in Nova. This is still in a roll-your-own mode for deployment. Brian ------------------------------------------------- Brian Schott, CTO Nimbis Services, Inc. brian.schott(a)nimbisservices.com <mailto:brian.schott@nimbisservices.com> ph: 443-274-6064 <tel:443-274-6064> fx: 443-274-6060 <tel:443-274-6060> On Jul 25, 2013, at 4:06 PM, Joshua Dotson <josh(a)knoesis.org <mailto:josh@knoesis.org> > wrote: Hello. A contingent of my organization, the Kno.e.sis Center @ Wright State University <http://www.knoesis.org/> , recently received a grant award which we intend to use to support a handful of mid-size HPC-style workloads (MPI <-- definitely, GPGPU <-- if possible/plausible) in addition to many mid-size IaaS-style workloads (MongoDB, Storm, Hadoop, many others). As a third layer, I'm playing with the idea of evaluating an elastic OpenShift Origin atop the same infrastructure. Approximately $400k to $500k will hopefully be available for this deployment, though exact numbers are not yet available to me. While I'm prepared to build a home-grown small-to-mid-size "classical" HPC, using modern hardware, and a smaller silo for home-grown Openstack for the minority stakeholders, I am hoping to find ways of making proponents of both workloads simultaneously happy, or close to it. That is, I would like to give my computer scientist users a friendly method of running their HPC-style jobs on a combined performance-tuned silo of Openstack. Doing so would load-balance the procured hardware and infrastructure with the users who want a Tomcat or a Virtuoso instance. I see a number of serious issues realizing such a goal. For example, the state of Infiniband vs. Openstack seems not quite ready/available/documented/accessible for such use in production, unless I'm just blind to the right blogs. The added myriad abstractions and latency virtualization might impose on an HPC task, not to mention cloud software defined networking (Quantum, especially when sans hardware acceleration), seem likely to really get in the way of practicality, economics and efficiency. That said, most of what we do here isn't HPC, so I believe such trade-offs can be agreed upon, if a reasonable job scheduling and workload management mechanism can be found and agreed upon by all stake holders, grant proposal majority (HPC) and minority (IaaS) alike. I get the impression from my readings that HPC-style deployment (separate from job queuing) against the EC2 API should work. I don't have a good feeling that the experience would be particularly friendly, however, without paying for closed source applications. I'm thinking a high-performance Ceph install would help bring up the storage end of things in a modern open-source CoTS way. I've not done specific research on Lustre + Openstack, but no reports of such a setup have presented themselves to me, either. These blue sky ideas matter nil, it seems, if a sufficiently-large high-performance production-quality Openstack deployment is beyond the funds to be allotted, which is something else I'm working on. I've built smallish but useful virt-manager, oVirt and Openstack environments here already, but none of them are enough for the very-important HPC job proposed for this grant. The scientist running the proposed computation gave me following information to clarify what would parity (for his job only) his experience running the computation with an external HPC service provider. * MPI * 20 Gbps Infiniband compute interconnect * 600 cores (those currently used are probably G4 Opteron 2.4 Ghz) * 4 GB RAM per core * at lest 2 TB shared storage, though I'm thinking we need much more for use by our general community * unsure of the storage networking topology We're in the shopping phase for this grant award and are still playing with ideas. It seems likely to snap back into an old-school HPC, at this time. I've fielded communication about our needs to a number of Openstack and hardware providers, on the hope that they can bring something helpful to the table. Please let know if you can point me in the right direction(s). I'm up to reading whatever text is thrown at me on this topic. :-) Thanks, Joshua -- Joshua M. Dotson Systems Administrator Kno.e.sis Center Wright State University - Dayton, OH _______________________________________________ OpenStack-HPC mailing list OpenStack-HPC(a)lists.openstack.org <mailto:OpenStack-HPC@lists.openstack.org> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-hpc _______________________________________________ OpenStack-HPC mailing list OpenStack-HPC(a)lists.openstack.org <mailto:OpenStack-HPC@lists.openstack.org> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-hpc _______________________________________________ OpenStack-HPC mailing list OpenStack-HPC(a)lists.openstack.org <mailto:OpenStack-HPC@lists.openstack.org> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-hpc

2 2

Call for Presentations: SC13 Dissertation Research Showcase and Early Research Showcase
by Wojtek James Goscinski 07 Jul '13

07 Jul '13

Submissions are now being accepted for the two tracks of the Doctoral Showcase program: • The Dissertation Research Showcase track for Ph.D. students who will be graduating in the next 12 months, and • The Early Research Showcase track for Ph.D. and master’s students who are in the early stages of their research. Applications for Doctoral Showcase due July 31, 2013 Dissertation Research Showcase The dissertation research of Ph.D. students in high performance computing, networking, storage and analysis will be spotlighted in the Doctoral Showcase program. This track provides a venue for Ph.D. students who will be graduating in the next 12 months to present a summary of their latest and systematic dissertation research. It provides an opportunity to educate junior graduate students working in high performance computing areas. This program also provides an ideal opportunity for prospective employers in academia, research laboratories and industry to interact with prospective Ph.D.s. Students are asked to submit a two-page summary of their research, publications list and three slides on their major results for consideration by the Doctoral Showcase committee. These accepted Ph.D. students will be invited for presentations at the SC13 conference. Everyone attending the conference is encouraged to attend this program. Come to see the latest and greatest dissertation work done by tomorrow’s HPC experts. Early Research Showcase The Early Research Showcase track provides early-stage research students with an opportunity to present their research and engage with the SC community. This track allows students in the first three years of their Ph.D. to present promising early-stage research, while encouraging conversations with HPC experts. The format of this track is a lightening presentation round and a poster exhibition that will be co-scheduled with the Dissertation Research Showcase. The showcase invites both students who are researching computational techniques and high performance computing, and students applying computational techniques to their scientific domain. Students are asked to submit a one-page summary of their research. Participating students are encouraged to use the poster session as a forum to introduce new approaches, discuss new technology, learn about relevant literature or define future research goals. Everyone attending the conference is encouraged to attend this program to engage with future HPC experts and provide valuable feedback and learn about future research developments. The Early Research Showcase is an evolution of the Early Adopters Ph.D. Workshops (SC09 to SC11). Visit the SC13 Doctoral Showcase webpage: http://sc13.supercomputing.org/content/doctoral-showcase-program And the submissions site: https://submissions.supercomputing.org/ Questions: doc-showcase(a)info.supercomputing.org

1 0

[HPC] Anyone interested in an HPC-themed unconference?
by John Paul Walters 16 Apr '13

16 Apr '13

Hi, We missed the deadline for an HPC related design summit session, but there's still time to sign up for an unconference if anyone's interested. Anyone interested? I'd propose one of the Wednesday slots. best, JP

6 7