VHPC'24<https://vhpc.org>: August 26th-27th, Madrid, Spain, co-located with Euro-Par 2024. Papers due: May 6th. The Workshop on Virtualization in High-Performance Cloud Computing (VHPC<https://vhpc.org>) aims to bring together researchers and industrial practitioners facing the challenges posed by virtualization in HPC/Cloud scenarios in order to foster discussion, collaboration, mutual exchange of knowledge and experience, enabling research to ultimately provide novel solutions for virtualized computing systems. The workshop features paper presentations, discussion sessions, and lightning talks. Accepted papers will be published in a Springer LNCS volume (indexed by Scopus and others). Focus Topics This year, we are calling the timely topic of virtualization in support of high-memory LLM training workloads including, but not limited to: * GPU hypervisor memory virtualization: Techniques for virtualizing GPU memory to allow flexible and efficient allocation across multiple workloads, enabling higher utilization of GPU resources * Flat CPU/GPU memory page tables/TLB: Unified virtual memory spaces and page table structures that allow both GPUs to address CPU memory mapped to accelerator global memory space * Storage/filesystem to virtual memory mapped approaches * Distributed memory virtualization * Memory compression and reduction techniques: approaches for compressing model parameters, activations, and gradients to reduce memory requirements during training * Out-of-core training algorithms * Efficient memory allocation and management: Techniques for optimizing memory allocation, reducing fragmentation, and improving memory utilization during training * Memory-efficient data formats and processing: Data formats and processing techniques that minimize memory overhead while maintaining training efficiency * Benchmarking and profiling tools: Tools and methodologies for measuring, analyzing, and optimizing memory usage in LLM training workloads * Case studies and applications: Real-world examples and applications of virtualization techniques in LLM training scenarios In addition to regular topics: * Container Platforms (Kubernetes, Docker, Nitro/Firecracker, Singularity, Shifter, rkt, …) and Unikernel Frameworks * Composable Lightweight Application Components and Lambda / Function-as-a-Service Paradigms * Latency Control, Warm/Cold-start issues and Data/Container Placement in Heterogeneous HPC Virtualized Environments * Energy-efficiency and Service Orchestration in Virtualized Cloud & HPC Infrastructures The call for papers is also available in PDF Format<https://vhpc.github.io/VHPC-CfP.pdf>. The workshop will be composed of 20 min paper presentations, each followed by 10 min discussion sessions, plus lightning talks that are limited to 5 minutes. Presentations may be accompanied by interactive demonstrations. For more information and detailed paper submission instructions, refer to the VHPC'24 webpage<https://vhpc.org/>. Important Dates (AoE) * May 6th, 2024: Paper submission deadline (Springer LNCS) * Jun 20th, 2024: Acceptance notification * Jul 1st, 2024: Camera-ready version due * Aug 26th-27th, 2024: Workshop Day General Chairs * Michael Alexander, Institute of Science and Technology, Austria * Anastassios Nanos, Nubificus Ltd., UK * Tommaso Cucinotta, Scuola Superiore Sant'Anna, Italy Publicity Chairs * Remo Andreoli, Scuola Superiore Sant'Anna, Italy General Information The workshop will be held in conjuction with the International European Conference on Parallel and Distributed Computing (Euro-Par 2024)<https://2024.euro-par.org>, on Aug 26th-27th, 2024, in Madrid, Spain. The VHPC co-chairs