Empowering Bioinformatics Workflows Using the Lustre Wide Area File System across a 100 Gigabit Network

No Thumbnail Available
Date
2012-09-11
Journal Title
Journal ISSN
Volume Title
Publisher
Abstract
Managing the profusion and accumulated volumes of life-science data is cumbersome; transferring them can require anything from shipping a hard drive to paying a graduate student to babysit transfers. Indiana University’s Data Capacitor solves this problem by exporting a high-performance Lustre file system across wide area networks to multiple locations. A mounted file system lets researchers run simple and familiar commands without having to contend with special tools for data transfer. Moreover, multiple mounts let researchers compute against their data from anywhere. To meet the insatiable bandwidth demands of life scientists, network infrastructure providers are increasingly offering 100 Gigabit circuits. IU recently used Lustre across a 100 Gigabit network spanning 2,300 miles to demonstrate application performance across a great distance. This presentation will describe the Data Capacitor cyber infrastructure and associated work, explore future use cases applicable to bioinformatics, and explain how the National Center for Genome Analysis Support (NCGAS) at Indiana University intends to integrate the Data Capacitor into their workflows.
Description
Presented at BioITWorld Cloud Summit September 11-13, 2012.
Keywords
lustre, 100Gigabit network, WAN file system, workflow, bioinformatics
Citation
DOI
Link(s) to data and video for this item
Relation
Rights
Except where otherwise noted, the contents of this presentation are © the Trustees of Indiana University. This content is released under the Creative Commons Attribution 3.0 Unported license (http://creativecommons.org/licenses/by/3.0/). This license includes the following terms: You are free to share – to copy, distribute and transmit the work and to remix – to adapt the work under the following conditions: attribution – you must attribute the work in the manner specified by the author or licensor (but not in any way that suggests that they endorse you or your use of the work). For any reuse or distribution, you must make clear to others the license terms of this work.
Type
Presentation
Collections