AI for Detecting Ocean Plastic Pollution with Tracking

November 1, 2023
In Progress
Share this project


Marine litter is a growing ecologic concern that needs to be addressed at a global scale. While satellite and meteorological data is available in abundance, few advances have been made towards continuous monitoring of marine litter aggregated in floating patches on the oceans. To address this, we propose ADOPT, a hybrid model to automatically identify marine litter from satellite imagery and predict its location given meteorological information. In the first instance, ADOPT contains a deep learning-based detection module to identify aggregations of floating debris. In a second instance, it employs a physical drift estimation module to project the pathway of detected debris in space and time. These modules ingest Sentinel-2 and PlanetScope satellite time series as well as meteorological data to provide up-to-date, high-resolution estimates of the locations of floating objects. This is crucial for on-site ship-based cleanup efforts that rely on accurate and timely information on floating litter islands for efficient collection. Automating floating debris detection poses several challenges: the domain shift between the globally distributed satellite scenes is strong; the small footprint of debris induces a severely imbalanced dataset; a visual identification of debris is difficult even for experts; noisy and incomplete labels pose challenges to automated machine learning methods. The two-layered strategy tackles these issues, where the segmentation module is aided by a machine-learning-based tracking module. Addressing this real-world challenge in a physically sound manner will provide a unique opportunity to deploy methods beyond idealized benchmarks, and with ecological impact, providing cleanup missions with up-to-date and physically plausible marine litter location estimations.



SDSC Team:
Christian Donner
Michele Volpi

PI | Partners:

EPFL, Environmental Computational Science and Earth Observation Laboratory:

  • Prof. Devis Tuia
  • Dr. Emmanuele Dalsasso

More info



Marine litter is accumulating at alarming rates, with 19 to 23 million metric tonnes dispersed in 2016 alone (Borrelle et al., 2020). Plastic artifacts constitute 75% of marine litter, exceeding 5 trillion objects in numbers (Eriksen et al., 2014) and are causing a serious threat to marine ecosystems, climate, and the human food chain. To understand the dynamics of plastic debris and finally remove it from the eco-system it is key to automatize large-scale detection.

Proposed Approach / Solution

This project aims at tracking plastic debris in the ocean with satellite imagery. This involves two modules (see Figure 1):

1) Debris detection: Utilizing Segmentation algorithms, e.g. UNET++ (Russwurm et al., 2023), to efficiently detect plastic debris on satellite images. Since data are scarce, semi-supervised approaches are a promising direction to explore,

2) Debris tracking: To learn the dynamics of plastic debris, models that predict the effective flow field based on currents, wind, and waves. After identifying the location of debris the model should predict likely positions of the debris the next time satellite imagery is available (1-5 days). The envisioned method should account for uncertainty of the predictions, such that a search area is identified for the segmentation module to look next (see Figure 2 for an example prediction with a Hidden Markov Model).


The final product, an “AI for Detecting Ocean Plastic Pollution with Tracking” (ADOPT), will be able to not only detect litter objects with high accuracy but also provide a timely estimate of future locations, thanks to its ability to process images of different satellite sensors and the inclusion of a physically sound ocean drift module for tracking.

Figure 1: Schematic of the project. The detection tool shown in the top part finds the debris, whereas the tracking module shown in the bottom part predicts where to look for the debris, when images are available again.
Figure 2: Prediction of a drifting object in the Gulf of Mexico: The red star indicates the true position of the object after 12 to 120 hours since the last observation. The color map is the probability density, where the ML-based method predicts the object to be.



Additional resources


  1. Borrelle, S. B., Ringma, J., Law, K. L., Monnahan, C. C., Lebreton, L., McGivern, A., ... & Rochman, C. M. (2020). Predicted growth in plastic waste exceeds efforts to mitigate plastic pollution. Science, 369(6510), 1515-1518. DOI: 10.1126/science.aba3656
  2. Eriksen, M., Lebreton, L. C., Carson, H. S., Thiel, M., Moore, C. J., Borerro, J. C., ... & Reisser, J. (2014). Plastic pollution in the world's oceans: more than 5 trillion plastic pieces weighing over 250,000 tons afloat at sea. PloS one, 9(12), e111913. DOI: 10.1371/journal.pone.0111913
  3. Carmo, R., Mifdal, J., & Rußwurm, M. (2021, September). Detecting macro floating objects on coastal water bodies using Sentinel-2 data. In OCEANS 2021: San Diego–Porto (pp. 1-7). IEEE. DOI: 10.23919/OCEANS44145.2021.9705668
  4. Russwurm, M. C., Gül, D., & Tuia, D. (2023, April). Improved marine debris detection in satellite imagery with automatic refinement of coarse hand annotations. In 11th International Conference on Learning Representations (ICLR) Workshops.


Related Pages

More projects


In Progress
Interpretable and Robust Machine Learning for Mobility Analysis
No items found.


In Progress
Feature Learning for Bayesian Inference
No items found.


In Progress
Personalized epidural electrical stimulation of the lumbar spinal cord for clinically applicable therapy to restore mobility after paralyzing spinal cord injury
No items found.


In Progress
Directed Imitation During Vocal Learning
No items found.


Latest news

Smartair | An active learning algorithm for real-time acquisition and regression of flow field data
May 1, 2024

Smartair | An active learning algorithm for real-time acquisition and regression of flow field data

Smartair | An active learning algorithm for real-time acquisition and regression of flow field data

We’ve developed a smart solution for wind tunnel testing that learns as it works, providing accurate results faster. It provides an accurate mean flow field and turbulence field reconstruction while shortening the sampling time.
The Promise of AI in Pharmaceutical Manufacturing
April 22, 2024

The Promise of AI in Pharmaceutical Manufacturing

The Promise of AI in Pharmaceutical Manufacturing

Innovation in pharmaceutical manufacturing raises key questions: How will AI change our operations? What does this mean for the skills of our workforce? How will it reshape our collaborative efforts? And crucially, how can we fully leverage these changes?
Efficient and scalable graph generation through iterative local expansion
March 20, 2024

Efficient and scalable graph generation through iterative local expansion

Efficient and scalable graph generation through iterative local expansion

Have you ever considered the complexity of generating large-scale, intricate graphs akin to those that represent the vast relational structures of our world? Our research introduces a pioneering approach to graph generation that tackles the scalability and complexity of creating such expansive, real-world graphs.

Contact us

Let’s talk Data Science

Do you need our services or expertise?
Contact us for your next Data Science project!