Wide Area Filesystem Performance using Lustre on the TeraGrid

Loading...
Thumbnail Image
Date
2007-06
Journal Title
Journal ISSN
Volume Title
Publisher
Abstract
Today’s scientific applications demand computational resources that can be provided only by parallel clusters of computers. Storage subsystems have responded to the increased demand for high-throughput disk access by moving to network attached storage. Emerging Cyberinfrastructure strategies are leading to geographically distributed computing resources such as the National Science Foundation’s TeraGrid. One feature of the TeraGrid is a dedicated national network with WAN bandwidth on the same scale as machine room bandwidth. A natural next step for storage is to export file systems across wide area networks to be available on diverse resources. In this paper we detail our testing with the Lustre file system across the TeraGrid network. On a single 10 Gbps WAN link we achieved single host performance approaching 700 MB/s for single file writes and 1GB/s for two simultaneous file writes with minimal tuning.
Description
In: Proceedings of TeraGrid 2007. (Madison, WI, 2007)
Keywords
TeraGrid, cyberinfrastructure, Lustre, WAN file systems
Citation
DOI
Link(s) to data and video for this item
Relation
Rights
Type
Technical Report