Semantic Segmentation of Underwater Imagery Using Deep Networks Trained on Synthetic Imagery
|Title:||Semantic Segmentation of Underwater Imagery Using Deep Networks Trained on Synthetic Imagery||Authors:||O'Byrne, Michael
|Permanent link:||http://hdl.handle.net/10197/10346||Date:||4-Aug-2018||Online since:||2019-05-08T11:55:17Z||Abstract:||Recent breakthroughs in the computer vision community have led to the emergence of efficient deep learning techniques for end-to-end segmentation of natural scenes. Underwater imaging stands to gain from these advances, however, deep learning methods require large annotated datasets for model training and these are typically unavailable for underwater imaging applications. This paper proposes the use of photorealistic synthetic imagery for training deep models that can be applied to interpret real-world underwater imagery. To demonstrate this concept, we look at the specific problem of biofouling detection on marine structures. A contemporary deep encoder–decoder network, termed SegNet, is trained using 2500 annotated synthetic images of size 960 × 540 pixels. The images were rendered in a virtual underwater environment under a wide variety of conditions and feature biofouling of various size, shape, and colour. Each rendered image has a corresponding ground truth per-pixel label map. Once trained on the synthetic imagery, SegNet is applied to segment new real-world images. The initial segmentation is refined using an iterative support vector machine (SVM) based post-processing algorithm. The proposed approach achieves a mean Intersection over Union (IoU) of 87% and a mean accuracy of 94% when tested on 32 frames extracted from two distinct real-world subsea inspection videos. Inference takes several seconds for a typical image.||Funding Details:||Science Foundation Ireland||Type of material:||Journal Article||Publisher:||MDPI AG||Journal:||Journal of Marine Science and Engineering||Volume:||6||Issue:||3||Start page:||1||End page:||15||Copyright (published version):||2018 the Authors||Keywords:||Semantic segmentation; Biofouling; Image processing; Underwater imaging||DOI:||10.3390/jmse6030093||Language:||en||Status of Item:||Peer reviewed|
|Appears in Collections:||Mechanical & Materials Engineering Research Collection|
Show full item record
This item is available under the Attribution-NonCommercial-NoDerivs 3.0 Ireland. No item may be reproduced for commercial purposes. For other possible restrictions on use please refer to the publisher's URL where this is made available, or to notes contained in the item itself. Other terms may apply.