Harvesting Field Station Data: Automating Raspberry Pi Sensors to Collaborative Websites, and Update
Field stations increasingly leverage remote sensors for large scale environmental data collection. Here we demonstrate a proof-of-concept workflow from data collection from remote sensors to presentation of summary results on a remote, and therefore fast and stable, cloud server. Environmental data is collected via raspberry pi's in several locations and data is streamed to the server on XSEDE's Jetstream, housed at Indiana University, through low-bandwith messaging. The Jetstream server does all the heavy lifting, exporting the data into a database, running automatically updating summary scripts to produce graphs, and hosting a Drupal-based website to present the data to collaborators or the public. While we use compact data in our demo, larger databases can be backed up on XSEDE's Wrangler, also housed at Indiana University. The end product is automatic aggregation and back up of sensor data onto a stable website that does not require a in-house server or large bandwidth on-site. This set-up is packaged into a ready-to-use and publically-available Jetstream image, meaning researchers could use their own sensors and R code for custom graphs with very little individual set up. Alternatively, the set-up can be used to house and display larger scale databases from other data types, such as audio recordings or photography. Future work will be in developing the ability to "pick up" data via drone fly-over and aggregation of citizen science data from multiple sites.
Sanders, S., E. Foran, E. Guido, J. Anderson, T. Slayton, T.G. Doak. 2019. Harvesting Field Station Data: Automating Data Flow from Raspberry Pi Sensors to Collaborative Websites, an Update. Annual Meeting of the Organization of Biological Field Stations, Maasmechelen, Belguim. Retrieved from http://hdl.handle.net/2022/25303.
Link(s) to data and video for this item
Except where otherwise noted, the contents of this presentation are copyright of the Trustees of Indiana University. This license includes the following terms: You are free to share -to copy, distribute and transmit the work and to remix -to adapt the work under the following conditions: attribution -you must attribute the work in the manner specified by the author or licensor (but not in any way that suggests that they endorse you or your use of the work). For any reuse or distribution, you must make clear to others the license terms of this work.