April 2015 - OpenStack-HPC - lists.openstack.org

Re: [openstack-hpc] +1 for OpenStack for HPC/HTC workloads at Vancouver
by Tim Bell 15 May '15

15 May '15

Anyone who would like to help out with the session organisation are welcome to add themselves to the Helpers list on https://etherpad.openstack.org/p/YVR-ops-hpc. I’ve had a number of productive discussions in the past summits where cloud/HPC/HTC folk get together and having something very interactive is the aim. Equally, feel free to add topics you’d like to find out if others have found solutions for to the etherpad…. We may not find solutions on the day but getting together people who share the same problems is already a major step forward. Tim From: <Villeneuve>, Donald H <donald.h.villeneuve(a)intel.com<mailto:donald.h.villeneuve@intel.com>> Date: Tuesday, April 28, 2015 at 7:13 PM To: "openstack-hpc(a)lists.openstack.org<mailto:openstack-hpc@lists.openstack.org>" <openstack-hpc(a)lists.openstack.org<mailto:openstack-hpc@lists.openstack.org>> Subject: [openstack-hpc] +1 for OpenStack for HPC/HTC workloads at Vancouver Following Tim Bell’s request, I’m sending this email to confirm my interest to meet folks running OpenStack for HPC purpose. Please keep posted with time and locations details. If I can help by actually doing something, let me know. Donald

3 5

NUMA config
by Blair Bethwaite 06 May '15

06 May '15

Hi all, Just reading over the docs describing NUMA scheduler filter testing (http://docs.openstack.org/developer/nova/devref/testing/libvirt-numa.html#t…) Somewhat confused by the scenario at the end, which seems to call for a guest with 1 NUMA node but looks like it gets created with 2... I'm obviously misunderstanding something in the resultant XML, but there's no topology info shown from inside the guest, so I'm not sure. Anyone tried this? -- Cheers, ~Blairo

5 8

+1 for OpenStack for HPC/HTC workloads at Vancouver
by Villeneuve, Donald H 28 Apr '15

28 Apr '15

Following Tim Bell's request, I'm sending this email to confirm my interest to meet folks running OpenStack for HPC purpose. Please keep posted with time and locations details. If I can help by actually doing something, let me know. Donald

1 0

Re: [openstack-hpc] [Openstack-operators] OpenStack HPC/HTC operator session
by Tim Bell 28 Apr '15

28 Apr '15

The slot is on Wednesday morning. Details are at https://libertydesignsummit.sched.org/event/66d9c49676797d30ae7815a7f1753ae… Tim From: Tim Bell Sent: 28 April 2015 08:52 To: 'Steven Carter (stevenca)'; openstack-hpc(a)lists.openstack.org Subject: RE: [Openstack-operators] OpenStack HPC/HTC operator session The current scheduling is planned for an HPC session on the Wednesday during the Ops working sessions. I'll try to get the exact time. Agenda being built up at https://etherpad.openstack.org/p/YVR-ops-hpc so feel free to add any items you'd like to discuss there. Tim From: Tim Bell <Tim.Bell(a)cern.ch<mailto:Tim.Bell@cern.ch>> Date: Thursday, April 16, 2015 at 3:10 AM To: "openstack-operators(a)lists.openstack.org<mailto:openstack-operators@lists.openstack.org>" <openstack-operators(a)lists.openstack.org<mailto:openstack-operators@lists.openstack.org>> Subject: [Openstack-operators] OpenStack HPC/HTC operator session There is an opportunity for a get-together of the people running OpenStack for HPC/HTC workloads at Vancouver. Getting the best of out of the cloud while at the same time meeting the needs of the user communities is a challenging job so sharing experiences for an hour would be really useful. We're collecting +1s for attendance on openstack-hpc(a)lists.openstack.org<mailto:openstack-hpc@lists.openstack.org> so please reply there if you'd be interested. Tim

1 0

Re: [openstack-hpc] [Openstack-operators] OpenStack HPC/HTC operator session
by Tim Bell 28 Apr '15

28 Apr '15

The current scheduling is planned for an HPC session on the Wednesday during the Ops working sessions. I'll try to get the exact time. Agenda being built up at https://etherpad.openstack.org/p/YVR-ops-hpc so feel free to add any items you'd like to discuss there. Tim From: Tim Bell <Tim.Bell(a)cern.ch<mailto:Tim.Bell@cern.ch>> Date: Thursday, April 16, 2015 at 3:10 AM To: "openstack-operators(a)lists.openstack.org<mailto:openstack-operators@lists.openstack.org>" <openstack-operators(a)lists.openstack.org<mailto:openstack-operators@lists.openstack.org>> Subject: [Openstack-operators] OpenStack HPC/HTC operator session There is an opportunity for a get-together of the people running OpenStack for HPC/HTC workloads at Vancouver. Getting the best of out of the cloud while at the same time meeting the needs of the user communities is a challenging job so sharing experiences for an hour would be really useful. We're collecting +1s for attendance on openstack-hpc(a)lists.openstack.org<mailto:openstack-hpc@lists.openstack.org> so please reply there if you'd be interested. Tim

1 0

FedCSIS 2015 - FINAL CALL FOR PAPERS
by Katarzyna Wasielewska 28 Apr '15

28 Apr '15

FINAL CALL FOR PAPERS 2015 Federated Conference on Computer Science and Information Systems (FedCSIS) Lodz, Poland, 13 - 16 September, 2015 www.fedcsis.org (FedCSIS on www.ieee.org: http://tinyurl.com/FedCSIS-on-IEEE-2015) We would like to cordially invite you to consider contributing a paper to the FedCSIS 2015 - an annual international multi-conference organized by the Polish Information Processing Society (PTI) in technical cooperation with the IEEE Region 8, IEEE Computer Society, IEEE Poland Section Computer Society Chapter, IEEE Poland (Gdansk) Section Computer Society Chapter, IEEE-CIS Poland Section Chapter, ACM Special Interest Group on Applied Computing, ACM Lodz Chapter, IEEE SMC Technical Committee on Computational Collective Intelligence, European Alliance for Innovation, Committee of Computer Science of the Polish Academy of Sciences, Polish Operational and Systems Research Society, Eastern Cluster ICT Poland, and Mazovia Cluster ICT. Please also forward the announcement to your colleagues and associates who could be interested in it. The FedCSIS Multi-conference consists of Events (conferences, symposia, workshops, special sessions). Each Event may run over any span of time within the conference dates (from half-day to four days). The FedCSIS Events provide a platform for bringing together researchers, practitioners, and academia to present and discuss ideas, challenges and potential solutions on established or emerging topics related to research and practice in computer science and information systems. Since 2012, Proceedings of the FedCSIS conference have been indexed in the Thomson Reuters Web of Science. FedCSIS EVENTS The FedCSIS multi-conference consists of EVENTS (conferences, workshops, consortia, tutorials, etc.), grouped into six conference areas. * AAIA'15 - 10th International Symposium Advances in Artificial Intelligence and Applications --- AIMaVIG'15 -1st International Workshop on Artificial Intelligence in Machine Vision and Graphics --- AIMA'15 - 5th International Workshop on Artificial Intelligence in Medical Applications --- ASIR'15 - 5th International Workshop on Advances in Semantic Information Retrieval --- CEIM'15 - 2nd Workshop on Complex Events and Information Modelling --- LQMR'15 - 1st Workshop on Logics for Qualitative Modelling and Reasoning --- WCO'15 - 8th Workshop on Computational Optimization * CSS - Computer Science & Systems --- BCPC'15 - 1st International Workshop on Biological, Chemical and Physical Computations --- CANA'15 - 8th Computer Aspects of Numerical Algorithms --- IWCPS'15 - 2nd International Workshop on Cyber-Physical Systems --- MMAP'15 - 8th International Symposium on Multimedia Applications and Processing --- WAPL'15 - 5th Workshop on Advances in Programming Languages * ECRM - Education, Curricula & Research Methods --- DS-RAIT'15 - 2nd Doctoral Symposium on Recent Advances in Information Technology --- WmL'15 - 1st International Workshop on Mobile Learning * iNetSApp'15 - 3rd International Conference on Innovative Network Systems and Applications --- EAIS'15 - 2nd Workshop on Emerging Aspects in Information Security --- SoFAST-WS'15 - 4th International Symposium on Frontiers in Network Applications, Network Systems and Web Services --- WSN'15 - 4th International Conference on Wireless Sensor Networks * IT4MBS - Information Technology for Management, Business & Society --- ABICT'15 - 6th International Workshop on Advances in Business ICT --- AITM'15 - 13th Conference on Advanced Information Technologies for Management --- ISM'15 - 10th Conference on Information Systems Management --- IT4L'15 - 4th Workshop on Information Technologies for Logistics --- KAM'15 - 21st Conference on Knowledge Acquisition and Management * JAWS - Joint Agent-oriented Workshops in Synergy --- ABC:MI'15 - 10th Workshop on Agent Based Computing: from Model to Implementation --- MAS&S'15 - 9th International Workshop on Multi-Agent Systems and Simulations --- SEN-MAS'15 - 4th International Workshop on Smart Energy Networks & Multi-Agent Systems KEYNOTE SPEAKERS - John F. Sowa, VivoMind Research, LLC: The Cognitive Cycle - Wojtek Kozaczynski, Microsoft, Redmond, WA, US: What has gone wrong in the cloud? Monitoring cloud infrastructure and things that run in it - Erik Proper, Luxembourg Institute of Science and Technology: Managed organisational self-creation through Business Informatics - Mohammed Atiquzzaman, School of Computer Science, University of Oklahoma: Extending the Internet to Space PAPER SUBMISSION AND PUBLICATION Papers should be submitted by May 8, 2015 (strict deadline). Preprints will be published on a USB memory stick provided to the FedCSIS participants. Only papers presented during the conference will be submitted to the IEEE for inclusion in the Xplore Digital Library. Furthermore, proceedings, published in a volume with ISBN, ISSN and DOI numbers will posted at the conference WWW site. Moreover, most Events' organizers arrange quality journals, edited volumes, etc. and may invite selected extended and revised papers for post-conference publications (information can be found at the websites of individual events). IMPORTANT DATES - Paper submission: May 8, 2015; midnight HST (strict deadline) - Acceptance decision: June 15, 2015 - Final version of paper submission: July 1, 2015 - Final deadline for discounted fee: July 1, 2015 - Conference dates: September 13-16, 2015 CHAIRS OF FedCSIS CONFERENCE SERIES Maria Ganzha, Leszek A. Maciaszek, Marcin Paprzycki CONTACT FedCSIS AT: secretariat(a)fedcsis.org FedCSIS on Facebook: http://tinyurl.com/FedCSISFacebook FedCSIS on LinkedIN: http://tinyurl.com/FedCSISLinkedIN

1 0

CfP Virtualization in High-Performance Cloud Computing Workshop (VHPC '15)
by VHPC 15 24 Apr '15

24 Apr '15

================================================================= CALL FOR PAPERS 10th Workshop on Virtualization in High-Performance Cloud Computing (VHPC '15) held in conjunction with Euro-Par 2015, August 24-28, Vienna, Austria (Springer LNCS) ================================================================= Date: August 25, 2015 Workshop URL: http://vhpc.org Paper Submission Deadline: May 22, 2015 CALL FOR PAPERS Virtualization technologies constitute a key enabling factor for flexible resource management in modern data centers, cloud environments, and increasingly in HPC as well. Providers need to dynamically manage complex infrastructures in a seamless fashion for varying workloads and hosted applications, independently of the customers deploying software or users submitting highly dynamic and heterogeneous workloads. Thanks to virtualization, we have the ability to manage vast computing and networking resources dynamically and close to the marginal cost of providing the services, which is unprecedented in the history of scientific and commercial computing. Docker et al. OS-level virtualization, with its capability to isolate multiple user-space environments allows for their co-existence within the same OS kernel. It promises to provide many of the advantages of machine virtualization with high levels of responsiveness and performance; coupled with lightweight OSs it forms a potent architecture with promise to become a mainstream environment for HPC workloads. Machine virtualization, with its capability to enable consolidation of multiple under-utilized servers with heterogeneous software and operating systems (OSes), and its capability to live-migrate a fully operating virtual machine (VM) with a very short downtime, enables novel and dynamic ways to manage physical servers; I/O Virtualization allows physical network adapters to take traffic from multiple VMs; network virtualization, with its capability to create logical network overlays that are independent of the underlying physical topology and IP addressing, provides the fundamental ground on top of which evolved network services can be realized with an unprecedented level of dynamicity and flexibility; These technologies have to be inter-mixed and integrated in an intelligent way, to support workloads that are increasingly demanding in terms of absolute performance, responsiveness and interactivity, and have to respect well-specified Service- Level Agreements (SLAs), as needed for industrial-grade provided services. The Workshop on Virtualization in High-Performance Cloud Computing (VHPC) aims to bring together researchers and industrial practitioners facing the challenges posed by virtualization in order to foster discussion, collaboration, mutual exchange of knowledge and experience, enabling research to ultimately provide novel solutions for virtualized computing systems of tomorrow. The workshop will be one day in length, composed of 20 min paper presentations, each followed by 10 min discussion sections, and lightning talks, limited to 5 minutes. Presentations may be accompanied by interactive demonstrations. TOPICS Topics of interest include, but are not limited to: - Virtualization in supercomputing environments, HPC clusters, cloud HPC and grids - OS-level virtualization including container runtimes (Docker, rkt et al.) - Lightweight compute node operating systems/VMMs - Optimizations of virtual machine monitor platforms, hypervisors and - Hypervisor and network virtualization QoS and SLAs - Cloud based network and system management for SDN and NFV - Management, deployment and monitoring of virtualized environments - Performance measurement, modelling and monitoring of virtualized/cloud workloads - Programming models for virtualized environments - Cloud reliability, fault-tolerance, high-availability and security - Heterogeneous virtualized environments, virtualized accelerators, GPUs and co-processors - Optimized communication libraries/protocols in the cloud and for HPC in the cloud - Topology management and optimization for distributed virtualized applications - Cluster provisioning in the cloud and cloud bursting - Adaptation of emerging HPC technologies (high performance networks, RDMA, etc..) - I/O and storage virtualization, virtualization aware file systems - Job scheduling/control/policy in virtualized environments - Checkpointing and migration of VM-based large compute jobs - Cloud frameworks and APIs - Energy-efficient / power-aware virtualization Important Dates April 29, 2015 - Abstract registration May 22, 2015 - Full paper submission June 19, 2015 - Acceptance notification October 2, 2015 - Camera-ready version due August 25, 2015 - Workshop Date TPC CHAIR Michael Alexander (chair), TU Wien, Austria Anastassios Nanos (co-chair), NTUA, Greece Balazs Gerofi (co-chair), RIKEN Advanced Institute for Computational Science, Japan PROGRAM COMMITTEE Stergios Anastasiadis, University of Ioannina, Greece Costas Bekas, IBM Zurich Research Laboratory, Switzerland Jakob Blomer, CERN Ron Brightwell, Sandia National Laboratories, USA Roberto Canonico, University of Napoli Federico II, Italy Julian Chesterfield, OnApp, UK Patrick Dreher, MIT, USA William Gardner, University of Guelph, Canada Kyle Hale, Northwestern University, USA Marcus Hardt, Karlsruhe Institute of Technology, Germany Iftekhar Hussain, Infinera, USA Krishna Kant, Temple University, USA Eiji Kawai, National Institute of Information and Communications Technology, Japan Romeo Kinzler, IBM, Switzerland Kornilios Kourtis, ETH, Switzerland Nectarios Koziris, National Technical University of Athens, Greece Massimo Lamanna, CERN Che-Rung Roger Lee, National Tsing Hua University, Taiwan William Magato, University of Cincinnati, USA Helge Meinhard, CERN Jean-Marc Menaud, Ecole des Mines de Nantes France Christine Morin, INRIA, France Amer Qouneh, University of Florida, USA Seetharami Seelam, IBM Watson Research Center, USA Josh Simons, VMWare, USA Borja Sotomayor, University of Chicago, USA Kurt Tutschku, Blekinge Institute of Technology, Sweden Yasuhiro Watashiba, Osaka University, Japan Chao-Tung Yang, Tunghai University, Taiwan PAPER SUBMISSION-PUBLICATION Papers submitted to the workshop will be reviewed by at least two members of the program committee and external reviewers. Submissions should include abstract, key words, the e-mail address of the corresponding author, and must not exceed 10 pages, including tables and figures at a main font size no smaller than 11 point. Submission of a paper should be regarded as a commitment that, should the paper be accepted, at least one of the authors will register and attend the conference to present the work. Accepted papers will be published in the Springer LNCS series - the format must be according to the Springer LNCS Style. Initial submissions are in PDF; authors of accepted papers will be requested to provide source files. Format Guidelines: http://www.springer.de/comp/lncs/authors.html Submission Link: https://easychair.org/conferences/?conf=europar2015ws GENERAL INFORMATION The workshop is one day in length and will be held in conjunction with Euro-Par 2015, 24-28 August, Vienna, Austria

1 0

Re: [openstack-hpc] CPU intensive apps on OpenStack
by Blair Bethwaite 23 Apr '15

23 Apr '15

Hi Tim, What's your reference on disabling EPT? I can find some fairly old stuff on this, but I thought newer processors had improved performance here to lower page fault overheads... so I guess I'm wondering if you've seen a recent evaluation somewhere? Re. NUMA etc, it seems like the most important thing if you're running large memory apps inside your guests is to make sure the guest is pinned (both CPU and NUMA wise) and sees a NUMA topology that matches how it is pinned on the host. I haven't had a chance to try it yet but I thought this was all now possible Juno. Beyond that you probably want the guest kernel to be NUMA sassy as well, so it needs (IIRC) Linux 3.13+ to get the numa_balancing (nee autonuma) goodies. I'm not sure if for such cases you might actually want to disable numa balancing on the host or whether the pinning would effectively remove any overhead there anyway... PS: +1 on the meetup suggestion -- Cheers, ~Blairo

4 4

+1 for HPC meeting in Vancouver
by Villeneuve, Donald H 17 Apr '15

17 Apr '15

Hi, New to this list, I would like to attend any HPC oriented meetings or presentation there may be in Vancouver. If to attend, some confirmation needs to be sent, please advise. I've been tasked to look into the provision of cluster with large node count. So far many ideas to make it happen. But I'm still learning my way around OpenStack. I'll be able to provide more details as a measure of success is achieved. Regards, Donald Villeneuve -----Original Message----- From: openstack-hpc-request(a)lists.openstack.org [mailto:openstack-hpc-request@lists.openstack.org] Sent: Thursday, April 16, 2015 10:36 PM To: openstack-hpc(a)lists.openstack.org Subject: OpenStack-HPC Digest, Vol 23, Issue 4 Send OpenStack-HPC mailing list submissions to openstack-hpc(a)lists.openstack.org To subscribe or unsubscribe via the World Wide Web, visit http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-hpc or, via email, send a message with subject or body 'help' to openstack-hpc-request(a)lists.openstack.org You can reach the person managing the list at openstack-hpc-owner(a)lists.openstack.org When replying, please edit your Subject line so it is more specific than "Re: Contents of OpenStack-HPC digest..." Today's Topics: 1. Re: +1 for attendance to the HPC get-together in Vancouver. (Tim Bell) 2. Re: +1 for attendance to the HPC get-together in Vancouver. (Matt Jarvis) 3. Re: +1 for attendance to the HPC get-together in Vancouver. (Matt Jarvis) 4. Re: CPU intensive apps on OpenStack (Blair Bethwaite) ---------------------------------------------------------------------- Message: 1 Date: Thu, 16 Apr 2015 13:02:17 +0000 From: Tim Bell <Tim.Bell(a)cern.ch> To: Matt Jarvis <matt.jarvis(a)datacentred.co.uk>, "openstack-hpc(a)lists.openstack.org" <openstack-hpc(a)lists.openstack.org> Subject: Re: [openstack-hpc] +1 for attendance to the HPC get-together in Vancouver. Message-ID: <5D7F9996EA547448BC6C54C8C5AAF4E501029CF555(a)CERNXCHG43.cern.ch> Content-Type: text/plain; charset="utf-8" Can you send round the slides URL ? Thanks Tim From: Matt Jarvis [mailto:matt.jarvis@datacentred.co.uk] Sent: 16 April 2015 12:28 To: openstack-hpc(a)lists.openstack.org Subject: [openstack-hpc] +1 for attendance to the HPC get-together in Vancouver. Hi, new to this list, but we're running ATLAS workloads for the University of Lancaster on our OpenStack public cloud in the UK, and actively looking to run more HPC/HTC type workloads. Would be interested in attending a session in Vancouver. Peter Love from Lancaster University recently presented at HEPIX in Oxford on some of the challenges around his work on our cloud, with comparison to grid sites. I'd be happy to share the slides if anyone is interested. -- Matt Jarvis Head of Cloud Computing DataCentred Office: (+44)0161 8703985 Mobile: (+44)07983 725372 Email: matt.jarvis(a)datacentred.co.uk<mailto:matt.jarvis@datacentred.co.uk> Website: http://www.datacentred.co.uk DataCentred Limited registered in England and Wales no. 05611763

3 2

+1 for attendance to the HPC get-together in Vancouver.
by Matt Jarvis 16 Apr '15

16 Apr '15

Hi, new to this list, but we're running ATLAS workloads for the University of Lancaster on our OpenStack public cloud in the UK, and actively looking to run more HPC/HTC type workloads. Would be interested in attending a session in Vancouver. Peter Love from Lancaster University recently presented at HEPIX in Oxford on some of the challenges around his work on our cloud, with comparison to grid sites. I'd be happy to share the slides if anyone is interested. -- Matt Jarvis Head of Cloud Computing DataCentred Office: (+44)0161 8703985 Mobile: (+44)07983 725372 Email: matt.jarvis(a)datacentred.co.uk Website: http://www.datacentred.co.uk -- DataCentred Limited registered in England and Wales no. 05611763

2 3