Code for management and processing of data for ESSD paper

Weber, S., Beutel, J., Da Forno, R., Geiger, A., Gruber, S., Gsell, T., Hasler, A., Keller, M., Lim, R., Limpach, P., Meyer, M., Talzi, I., Thiele, L., Tschudin, C., Vieli, A., Vonder Mühll, D., and Yücel, M.: A decade of detailed observations (2008–2018) in steep bedrock permafrost at the Matterhorn Hörnligrat (Zermatt, CH), Earth Syst. Sci. Data, 11, 1203–1237, https://doi.org/10.5194/essd-11-1203-2019, 2019.

Authors: Samuel Weber, Jan Beutel, Matthias Meyer

Copyright: ETH Zurich, 2019

Version: 1.0, January 23,2019

GSN DATA MANAGEMENT TOOLCHAIN

The Python3 GSN data management toolbox allows to:

• Query data from PermaSense GSN~server and save it locally as csv-files,
• Reload the locally stored csv-files,
• Filter according reference values if available,
• Clean data manually if needed,
• Generate 60-minute aggregates using in principle arithmetic mean (exceptions for weather data, see ESSD paper Weber et al., 2019),
• Export yearly csv-files for each position/location,
• Generate standard plots for all positions/locations as sanity check and
• Query images from PermaSense GSN~server and save it locally as jpg-files.

Requirements

Python and additional modules are required. Using anaconda you can install the requirements by executing the following command from this directory.

conda env create -f condaEnvironment.yml
source activate manage_GSNdata

Note: Before you can use the function get_GSNimg in manage_GSNdata.py, you have to download NConvert and copy it in the directory gsn_data_management.

• NConvert is a powerful command line multi-platform batch image processor with more than 80 commands. Compatible with 500 image formats.
• Download: https://www.xnview.com/en/nconvert/

Getting Started

Run:

python manage_GSNdata.py

By default data are generated in a subdirectory ./mh_data