Towards Continuous Floating Invasive Plant Removal Using Unmanned Surface Vehicles and Computer Vision

Abstract

Deficient domestic wastewater management, industrial waste, and floating debris are some leading factors that contribute to inland water pollution. The surplus of minerals and nutrients in overly contaminated zones can lead to the invasion of different invasive weeds. Lemnoideae, commonly known as duckweed, is a family of floating plants that has no leaves or stems and forms dense colonies with a fast growth rate. If not controlled, duckweed establishes a green layer on the surface and depletes fish and other organisms of oxygen and sunlight. In the last decades, duckweed blooms have become an expensive plague to remove in Lake Titicaca, causing significant biodiversity and economic losses. To address this issue, we propose the development of an unmanned surface vehicle (USV) to continuously monitor and collect duckweed. This device includes a steering angle estimation system (SAE) that combines a duckweed detector, a steering angle classifier, and a momentum-inspired module to determine continuously the orientation of the USV when it is inspecting a zone. We train and test our deep learning-based models with two novel datasets: first, a dataset for end-to-end steering angle classification collected synthetically using a bespoke simulator; and second, a dataset for duckweed detection. An experimental evaluation of the USV and SAE system is provided in virtual and outdoor environments.

Team

Edwin Salcedo

Yamil Uchani

Misael Mamani

Mariel Fernandez

Code

Implementation for this publication is available on GitHub.

https://github.com/EdwinTSalcedo/RecyclingRush

Dataset

The present investigation made use of two dataset: one for steering angle prediction, and another one for duckweed detection. While the former is available under request, the latter is freely available on IEEE Dataport.

Dataset

The present investigation made use of two dataset: one for steering angle prediction, and another one for duckweed detection. While the former is available under request, the latter is freely available on IEEE Dataport.

BibTeX

@article{ _recyclingrush_2024,
  author  = { Edwin Salcedo and Yamil Uchani and Misael Mamani and Mariel Fernandez },
  title   = { Towards Continuous Floating Invasive Plant Removal Using Unmanned Surface Vehicles and Computer Vision },
  journal = { IEEE Access },
  year    = { 2024 },
  doi     = { 10.1109/ACCESS.2024.3351764 },
  url     = { https://doi.org/10.1109/ACCESS.2024.3351764 },
  volume  = { 12 }
}

Acknowledgement

The proposed approach won the First Global Prize in the OpenCV AI Competition 2022 that was organized by the OpenCV Foundation.