Rockhopper: a True HPC System with Cloud Concepts

Abstract
A number of services for scientific computing based on cloud resources have recently drawn significant attention in both research and infrastructure provider communities. Most cloud resources currently available lack true high performance characteristics, such as high-speed interconnects or storage. Researchers studying cloud systems have pointed out that many cloud services do not provide service level agreements that may meet the needs of the research community. Furthermore, the lack of location information provided to the user and the shared nature of the systems use may create risk for users of the system, in the instance that their data is moved to an unknown location with an unknown level of security. Indiana University and Penguin Computing have partnered to create a system, Rockhopper, which addresses many of these issues. This system is a true high performance resource, with on-demand allocations and control and tracking of jobs, situated at Indiana University's high-security datacenter facility. Rockhopper allows researchers to flexibly conduct their work under a number of use cases while also serving as an extension of cyberinfrastructure that scales from the researcher's local environment all the way up through large national resources. We describe the architecture and ideas behind the creation of the system, present a use case for campus bridging, and provide a typical example of system usage. In a comparison of Rockhopper to a cloud-based system, we run the Trinity RNA-seq software against a number of datasets on both the Rockhopper system and on Amazon's EC2 service.
Description
Presented at IEEE Cluster 2013 in Indianapolis, IN
Keywords
campus bridging, hpc, high-performance computing, cluster, cloud, penguin computing
Citation
DOI
Link(s) to data and video for this item
Relation
Rights
Except where otherwise noted, the contents of this presentation are copyright of the Trustees of Indiana University. This content is released under the Creative Commons Attribution 3.0 Unported license (http://creativecommons.org/licenses/by/3.0/). This license includes the following terms: You are free to share - to copy, distribute and transmit the work and to remix - to adapt the work under the following conditions: attribution - you must attribute the work in the manner specified by the author or licensor (but not in any way that suggests that they endorse you or your use of the work). For any reuse or distribution, you must make clear to others the license terms of this work.
Type
Other
Collections