SC|07 Bandwidth Challenge award-winning project: Using the Data Capacitor for Remote Data Collection, Analysis, and Visualization

Abstract

In 2006, Indiana University led a team that received an honorable mention in the SC06 bandwidth challenge. The following year, IU expanded its team to include representatives of Technische Universität Dresden (TUD) in Germany and the Rochester Institute of Technology (RIT) in New York. The title of the 2007 project was “Using the Data Capacitor for Remote Data Collection, Analysis, and Visualization.” We believe that distributed workflows represent an important category of scientific application workflows that make possible new and more rapid discoveries using grids and distributed workflow tools. We believe that short-term storage systems have a particularly important role to play in distributed workflows. The IU Data Capacitor is a 535 TB distributed object store file system constructed for short- to mid-term storage of large research data sets.