Wide Area Filesystem Performance using Lustre on the TeraGrid

Loading...
Thumbnail Image
Can’t use the file because of accessibility barriers? Contact us with the title of the item, permanent link, and specifics of your accommodation need.

Date

2007-06

Journal Title

Journal ISSN

Volume Title

Publisher

Abstract

Today’s scientific applications demand computational resources that can be provided only by parallel clusters of computers. Storage subsystems have responded to the increased demand for high-throughput disk access by moving to network attached storage. Emerging Cyberinfrastructure strategies are leading to geographically distributed computing resources such as the National Science Foundation’s TeraGrid. One feature of the TeraGrid is a dedicated national network with WAN bandwidth on the same scale as machine room bandwidth. A natural next step for storage is to export file systems across wide area networks to be available on diverse resources. In this paper we detail our testing with the Lustre file system across the TeraGrid network. On a single 10 Gbps WAN link we achieved single host performance approaching 700 MB/s for single file writes and 1GB/s for two simultaneous file writes with minimal tuning.

Description

In: Proceedings of TeraGrid 2007. (Madison, WI, 2007)

Keywords

TeraGrid, cyberinfrastructure, Lustre, WAN file systems

Citation

Journal

DOI

Link(s) to data and video for this item

Relation

Rights

Type

Technical Report