CLIMIS4AVAL

Real-time cleansing of snow and weather data for operational avalanche forecasting

Started
October 19, 2022
Status
In Progress
Share this post

Abstract

Avalanche forecasting relies on snow, snow cover and weather data – for expert evaluation as well as for machine learning based support tools. The data need to be accessible in high quality as soon as these become available. Any measurement errors, anomalies and data gaps diminish forecast accuracy.

Avalanche forecasting, physical snow models, hydrological predictions and many other Alpine scientific activities are largely data-driven; therefore, consistent and accurate data are fundamental for high-quality outputs. With increasing data volumes and the increased need for timely and accurate forecasts, preferably automated location-based forecasts, it becomes imperative to clean these essential data on the fly.

People

Scientists

SDSC Team:
PI | Partners

description

Introduction:

The backbone of the Swiss avalanche forecast infrastructure are the data of the Intercantonal Measurement and Information System (IMIS), which currently consists of 187 automated snow and weather stations. They are distributed throughout the Swiss Alps and in most cases are situated in the high alpine region above the tree line. The stations continuously record the snow and weather conditions, transmit data to the SLF every hour and provide the national avalanche warning service of the SLF as well as local avalanche services responsible for public safety in settlements and on roads with the crucial information for danger assessment. Public products such as new snow or snow height maps also rely on these data.

Therefore, the objective is the development of algorithms that allow real-time detection of anomalies in the time series, but also the detection of outliers, and impute missing data by applying state-of-the-art machine learning approaches.

This real-time data cleansing will solve a long-standing issue with the IMIS data that are known to be contaminated with data anomalies and has hindered automated processing. Hence, the completion of the proposed research will have a major impact, in particular for the application of numerical avalanche prediction models such as we recently developed in collaboration with the SDSC.

Problem:

This project aims to perform anomaly detection, outlier detection, and imputation on IMIS station data both retrospectively and in real time. In particular, the project focuses on the measurements of snow depth, wind speed and direction, air temperature, precipitation, and a maintenance model.

Proposed approach:

The SDSC is working with SLF to apply time-series-based statistical and machine learning-based methods for anomaly detection, outlier detection, and imputation in the given context.

Impact:

Numerical avalanche prediction and other models used at SLF will be more accurate with the cleaned data. The cleaned data will also be made openly available in the data portal of SLF, and will therefore benefit the numerous downstream users of the data.

Weather station at SLF

Gallery

Annexe

Additionnal resources

Bibliography

  1. Bavay, M. and Egger, T.: MeteoIO 2.4.2: a preprocessing library for meteorological data, Geosci. Model Dev., 7, 3135–3151, https://doi.org/10.5194/gmd-7-3135-2014, 2014.
  2. Pérez-Guillén, C., Techel, F., Hendrick, M., Volpi, M., van Herwijnen, A., Olevski, T., Obozinski, G., Pérez-Cruz, F., and Schweizer, J.: Data-driven automated predictions of the avalanche danger level for dry-snow conditions in Switzerland, Nat. Hazards Earth Syst. Sci., 22, 2031–2056, https://doi.org/10.5194/nhess-22-2031-2022, 2022.

Publications

Related Pages

More projects

ML4FCC

In Progress
Machine Learning for the Future Circular Collider Design
Big Science Data

SEMIRAMIS

Completed
AI-augmented architectural design
Energy, Climate & Environment

4D-Brains

In Progress
Extracting activity from large 4D whole-brain image datasets
Biomedical Data Science

deepLNAfrica

In Progress
Deep statistical learning-based image analysis for measurement of socioeconomic development in sub-Saharan Africa using high-resolution satellite images, and geo-referenced household survey data
Energy, Climate & Environment

News

Latest news

Climate-smart agriculture in sub-Saharan Africa: optimizing nitrogen fertilization with data science
November 6, 2023

Climate-smart agriculture in sub-Saharan Africa: optimizing nitrogen fertilization with data science

Climate-smart agriculture in sub-Saharan Africa: optimizing nitrogen fertilization with data science

Food insecurity in sub-Saharan Africa is widespread, with crop yields much lower than in many developed regions. The project aims to use laser spectroscopy to measure fluxes and isotopic composition of N2O from maize and potato crops subjected to a range of fertilization levels.
Street2Vec | Self-supervised learning unveils change in urban housing from street-level images
October 31, 2023

Street2Vec | Self-supervised learning unveils change in urban housing from street-level images

Street2Vec | Self-supervised learning unveils change in urban housing from street-level images

It is difficult to effectively monitor and track progress in urban housing. We attempt to overcome these limitations by utilizing self-supervised learning with over 15 million street-level images taken between 2008 and 2021 to measure change in London.
DLBIRHOUI | Deep Learning Based Image Reconstruction for Hybrid Optoacoustic and Ultrasound Imaging
February 28, 2023

DLBIRHOUI | Deep Learning Based Image Reconstruction for Hybrid Optoacoustic and Ultrasound Imaging

DLBIRHOUI | Deep Learning Based Image Reconstruction for Hybrid Optoacoustic and Ultrasound Imaging

Optoacoustic imaging is a new, real-time feedback and non-invasive imaging tool with increasing application in clinical and pre-clinical settings. The DLBIRHOUI project tackles some of the major challenges in optoacoustic imaging to facilitate faster adoption of this technology for clinical use.

Contact us

Let’s talk Data Science

Do you need our services or expertise?
Contact us for your next Data Science project!