April 2014 - OpenStack-HPC - lists.openstack.org

Atlanta Summit
by McMillan, Scott A 09 May '14

09 May '14

Hi, Are there any plans for HPC focused sessions (official or unofficial) or meetups during the May OpenStack Summit in Atlanta? Thanks, Scott

9 15

Questions about porting StarCluster to OpenStack
by Jonathan Proulx 19 Apr '14

19 Apr '14

Hi All, For those who don't know me I deployed and run the OpenStack cloud at MIT CSAIL (http://www.csail.mit.edu) I'm currently working with Justin Riley (address in the "To" header of this email) who's the primary developer for StarCluster [http://star.mit.edu/cluster/index.html] on porting StarCluster to OpenStack. We have some operational and use case questions before we get too far down the implementation rathole^H^H^H^H^H^H^H path. I've sent this to openstack-hpc and some select bcc's to get a sense of who might be interest and what opinions you have about how the port should be implemented. What is it? If your not familiar, StarCluster is is an open source cluster-computing toolkit for Amazon’s Elastic Compute Cloud (EC2) released under the LGPL license. It has been designed to automate and simplify the process of building, configuring, and managing clusters of virtual machines on Amazon’s EC2 cloud. StarCluster allows anyone to easily create a cluster computing environment in the cloud suited for distributed and parallel computing applications and systems. It's main target audience is domain scientists who want to setup a SGE, Condor, Hadoop, and a few other sorts of cluster in "the cloud". Its current implementation is basically a config file driven CLI that uses locally stored ssh keys for managing running the cluster. It has a fair sized user community and people seem to like it, which is why one of my users introduced Justin and I so I could provide a place for Justin to work and my user could get StarCluster on our private cloud. Were is it at? The CLI "basically works" on OpenStack now, though so far no end-users have touched it so not quite ready for public beta. If you're really interested in early code I'm sure Justin will be happy to share if you ask nicely. He has also been working on a Horizon dashboard which would be an additional feature for the OpenStack version (there is no EC2 GUI). The BIG QUESTIONS? Do you think this is something that would be useful to your users? To enable full functionality in the Horizon dashboard the dashboard app needs access to a private key to access the running (virtual) cluster nodes as root. Waving hands over implementation details, and assuming you're interested in this functionality of you're this far into the email. Is storing key material a show stopper in your environment? In other words would you rather just fall back to the CLI with it's local ~/.ssh/id_rsa (or equivalent) for privileged operations? My Opinion... I don't like centrally storing crypto keys, but my horizon runs on my controller node so it is already a fairly privileged zone, and I don't necessarily trust my users to store their key material even as well as this could be done. So while a bit cautious about the details I think it is an acceptable risk in my (admittedly permissive) environment. Thoughts? -Jon

4 3

Fwd: HPC topics in the operators summit
by Brian Schott 14 Apr '14

14 Apr '14

Rather than cross-post, here is what I just posted on the operators list. ------------------------------------------------- Brian Schott, CTO Nimbis Services, Inc. brian.schott(a)nimbisservices.com ph: 443-274-6064 fx: 443-274-6060 Begin forwarded message: > From: Brian Schott <brian.schott(a)nimbisservices.com> > Subject: HPC topics in the operators summit > Date: April 14, 2014 at 10:58:23 AM EDT > To: openstack-operators(a)lists.openstack.org > > We just got turned down for an HPC-specific session in Atlanta and found the ops unconference after Thierry mentioned it. > https://etherpad.openstack.org/p/ATL-ops-unconference-RFC > > Would there be space/interest for a few HPC topics in the operator's summit? > https://etherpad.openstack.org/p/juno-hpc-unconference > http://summit.openstack.org/cfp/details/227 > > Thanks, > brian > > ------------------------------------------------- > Brian Schott, CTO > Nimbis Services, Inc. > brian.schott(a)nimbisservices.com > ph: 443-274-6064 fx: 443-274-6060 > > > > Begin forwarded message: > >> From: Thierry Carrez <thierry(a)openstack.org> >> Subject: Re: [DesignSummit] Status change on your session proposal >> Date: April 14, 2014 at 10:33:21 AM EDT >> To: Brian Schott <brian.schott(a)nimbisservices.com>, russell(a)russellbryant.net >> >> Brian Schott wrote: >>> Will there be any other opportunities for HPC folks to get meeting >>> space? It wasn't clear from the web what the unconference setup would >>> be this year. >> >> There is no "unconference" this time. You might want to see if the >> Operators summit would have room to discuss HPC. To discuss specific >> contributions, you should engage with each project and try to get space >> in their project tracks. >> >> Regards, >> >> -- >> Thierry Carrez (ttx) >

1 0