DATALAKES

Heterogeneous data platform for operational modelling and forecasting of Swiss lakes

Started
February 1, 2019
Status
Completed
Share this project

Abstract

The objective of this project is to advance the forecasting capabilities of the data-driven hydrological and ecological lake modeling algorithms using methodologies inspired by data science and accelerated by high performance computing.

We aim to develop a parallel framework interfacing high resolution 3D numerical solvers for the underlying lake dynamics with modern numerical Markov Chain Monte Carlo sampling methods for Bayesian inference, with particular interest in investigating particle filtering and multi-level variance reduction methodologies. The resulting framework aims at accurate data assimilation and uncertainty quantification in both model parameters and the associated forecasts.

DATALAKES project is a collaboration with the Swiss Data Science Center (SDSC), EPF Lausanne and ETH Zurich, aiming at a sensor-to-frontend data platform providing and analyzing the dynamics of lake ecosystems at high spatial and temporal resolutions. Current version of the existing framework can be found at meteolakes.ch.

People

Collaborators

SDSC Team:
Eric Bouillet
Firat Ozdemir
Fernando Perez-Cruz
Fotis Georgatos
Emma Jablonski

PI | Partners:

Eawag, Scientific Computing Group:

  • Dr. Jonas Sukys
  • Dr. Artur Safin
  • James Runnalls

More info

Eawag, Aquatic Physics:

  • Dr. Damien Bouffard

More info

EPFL, Aquatic Systems Laboratory:

  • Prof. Dr. Alfred Johny Wüest

More info

description

Problem:

  • Increasing pressure on lakes needs scientific support
  • 3D numerical simulations of lakes require input data – uncertainty quantification in parameters & forecast
  • New L’EXPLORE platform in Lake Geneva – increasing availability of high resolution data

Solution:

  • Sensor-to-frontend open data platform
  • Physics-driven hydrodynamic models
  • Data-driven modeling of input data processes
  • Parallel Bayesian inference – MCMC with ABC or PF
  • Multi-level speedup – hierarchical numerical models
  • Powered by Renku, the SDSC-developed platform for transparency and reproducibility in science
  • A neural network with uncertainty quantification properties in order to more accurately aggregate data from satellite imagery into the Bayesian inference

Impact

  • Real time monitoring & future forecast of lakes
  • Platform for large-scale interdisciplinary collaborations
  • Research in hydrological / ecological lake modeling
  • Scientifically grounded water resources management

Gallery

Annexe

Publications

  • D. Bouffard, J Runnalls, T Baracchini, E Bouillet, H E Chmiel, T Doda, B Fernández Castro, F Georgatos, S Lavanchy, C Minaudo, F Ozdemir, D Odermatt, M-E Perga, P Perolo, S Piccolroaz, M Plüss, L Råman Vinnå, M Schmid, A Safin, J Šukys, V Tran-Khac, H N. Ulloa, C L. Ramón, A Wüest. Datalakes, a data platform for Swiss lakes. In prep for Earth System Data Science
  • Safin, A., Bouffard, D., Ozdemir, F., Ramón, C. L., Runnalls, J., Georgatos, F., Minaudo, C., and Šukys, J.: A Bayesian data assimilation framework for lake 3D hydrodynamic models with a physics-preserving particle filtering method using SPUX-MITgcm v1, Geosci. Model Dev., 15, 7715–7730, A Bayesian data assimilation framework for lake 3D hydrodynamic models with a physics-preserving particle filtering method using SPUX-MITgcm v1 , 2022

Bibliography

Publications

Related Pages

More projects

ML-L3DNDT

Completed
Robust and scalable Machine Learning algorithms for Laue 3-Dimensional Neutron Diffraction Tomography
Big Science Data

BioDetect

Completed
Deep Learning for Biodiversity Detection and Classification
Energy, Climate & Environment

IRMA

In Progress
Interpretable and Robust Machine Learning for Mobility Analysis
No items found.

FLBI

In Progress
Feature Learning for Bayesian Inference
No items found.

News

Latest news

Smartair | An active learning algorithm for real-time acquisition and regression of flow field data
May 1, 2024

Smartair | An active learning algorithm for real-time acquisition and regression of flow field data

Smartair | An active learning algorithm for real-time acquisition and regression of flow field data

We’ve developed a smart solution for wind tunnel testing that learns as it works, providing accurate results faster. It provides an accurate mean flow field and turbulence field reconstruction while shortening the sampling time.
The Promise of AI in Pharmaceutical Manufacturing
April 22, 2024

The Promise of AI in Pharmaceutical Manufacturing

The Promise of AI in Pharmaceutical Manufacturing

Innovation in pharmaceutical manufacturing raises key questions: How will AI change our operations? What does this mean for the skills of our workforce? How will it reshape our collaborative efforts? And crucially, how can we fully leverage these changes?
Efficient and scalable graph generation through iterative local expansion
March 20, 2024

Efficient and scalable graph generation through iterative local expansion

Efficient and scalable graph generation through iterative local expansion

Have you ever considered the complexity of generating large-scale, intricate graphs akin to those that represent the vast relational structures of our world? Our research introduces a pioneering approach to graph generation that tackles the scalability and complexity of creating such expansive, real-world graphs.

Contact us

Let’s talk Data Science

Do you need our services or expertise?
Contact us for your next Data Science project!