Big Data on Ice: The Forward Observer System for In-flight Synthetic Aperture Radar Processing

Loading...
Thumbnail Image
Date
2015
Journal Title
Journal ISSN
Volume Title
Publisher
Abstract
We introduce the Forward Observer system, which is designed to provide data assurance in field data acquisition while receiving significant amounts (several terabytes per flight) of Synthetic Aperture Radar data during flights over the polar regions, which provide unique requirements for developing data collection and processing systems. Under polar conditions in the field and given the difficulty and expense of collecting data, data retention is absolutely critical. Our system provides a storage and analysis cluster with software that connects to field instruments via standard protocols, replicates data to multiple stores automatically as soon as it is written, and provides pre-processing of data so that initial visualizations are available immediately after collection, where they can provide feedback to researchers in the aircraft during the flight.
Description
Article from presentation at the International Conference On Computational Science, ICCS 2015 Computational Science at the Gates of Nature
Keywords
polar science,big data,operation icebridge
Citation
Knepper. R., Link, M.R., Standish, M. 2015. Big Data on Ice: The Forward Observer System for In-flight Synthetic Aperture Radar Processing. Procedia Computer Science, Vol. 51., 2015, pp.1504-1513. Elsevier.
DOI
Link(s) to data and video for this item
Relation
Rights
Except where otherwise noted, the contents of this presentation are copyright of the Trustees of Indiana University. This content is released under the Creative Commons Attribution 3.0 Unported license (http://creativecommons.org/licenses/by/3.0/). This license includes the following terms: You are free to share - to copy, distribute and transmit the work and to remix - to adapt the work under the following conditions: attribution - you must attribute the work in the manner specified by the author or licensor (but not in any way that suggests that they endorse you or your use of the work). For any reuse or distribution, you must make clear to others the license terms of this work
Type
Technical Report