Code for management and processing PermaSense data

Authors: Samuel Weber, Jan Beutel, Matthias Meyer Copyright: ETH Zurich, 2020 Version: 2.0, March 30,2020

Used for following publication(s)

• Weber, S., Beutel, J., Da Forno, R., Geiger, A., Gruber, S., Gsell, T., Hasler, A., Keller, M., Lim, R., Limpach, P., Meyer, M., Talzi, I., Thiele, L., Tschudin, C., Vieli, A., Vonder Mühll, D., and Yücel, M.: A decade of detailed observations (2008–2018) in steep bedrock permafrost at the Matterhorn Hörnligrat (Zermatt, CH), Earth Syst. Sci. Data, 11, 1203–1237, https://doi.org/10.5194/essd-11-1203-2019, 2019.

GSN DATA MANAGEMENT TOOLCHAIN

The Python3 GSN data management toolbox allows to:

• Query data from PermaSense GSN~server and save it locally as csv-files,
• Reload the locally stored csv-files,
• Filter according reference values if available,
• Clean data manually if needed,
• Generate 60-minute aggregates using in principle arithmetic mean (exceptions for weather data, see ESSD paper Weber et al., 2019),
• Export yearly csv-files for each position/location,
• Generate standard plots for all positions/locations as sanity check and
• Query images from PermaSense GSN~server and save it locally as jpg-files.

Requirements

Python and additional modules are required. Using anaconda you can install the requirements by executing the following command from this directory.

conda env create -f condaEnvironment.yml
source activate essd_zenodo_datamgr

Note: Before you can use the function get_GSNimg in manage_GSNdata.py, you have to download NConvert and copy it in the directory gsn_data_management.

• NConvert is a powerful command line multi-platform batch image processor with more than 80 commands. Compatible with 500 image formats.
• Download: https://www.xnview.com/en/nconvert/

Getting Started

Run:

python manage_GSNdata.py

By default data are generated in a subdirectory ./data