Semantic Segmentation of Underwater Imagery Using Deep Networks Trained on Synthetic Imagery

Files in This Item:
File Description SizeFormat 
jmse-331333-update.pdf4.59 MBAdobe PDFDownload
Title: Semantic Segmentation of Underwater Imagery Using Deep Networks Trained on Synthetic Imagery
Authors: O'Byrne, Michael
Pakrashi, Vikram
Schoefs, Franck
Ghosh, Bidisha
Permanent link:
Date: 4-Aug-2018
Online since: 2019-05-08T11:55:17Z
Abstract: Recent breakthroughs in the computer vision community have led to the emergence of efficient deep learning techniques for end-to-end segmentation of natural scenes. Underwater imaging stands to gain from these advances, however, deep learning methods require large annotated datasets for model training and these are typically unavailable for underwater imaging applications. This paper proposes the use of photorealistic synthetic imagery for training deep models that can be applied to interpret real-world underwater imagery. To demonstrate this concept, we look at the specific problem of biofouling detection on marine structures. A contemporary deep encoder–decoder network, termed SegNet, is trained using 2500 annotated synthetic images of size 960 × 540 pixels. The images were rendered in a virtual underwater environment under a wide variety of conditions and feature biofouling of various size, shape, and colour. Each rendered image has a corresponding ground truth per-pixel label map. Once trained on the synthetic imagery, SegNet is applied to segment new real-world images. The initial segmentation is refined using an iterative support vector machine (SVM) based post-processing algorithm. The proposed approach achieves a mean Intersection over Union (IoU) of 87% and a mean accuracy of 94% when tested on 32 frames extracted from two distinct real-world subsea inspection videos. Inference takes several seconds for a typical image.
Funding Details: Science Foundation Ireland
Type of material: Journal Article
Publisher: MDPI AG
Journal: Journal of Marine Science and Engineering
Volume: 6
Issue: 3
Start page: 1
End page: 15
Copyright (published version): 2018 the Authors
Keywords: Semantic segmentationBiofoulingImage processingUnderwater imaging
DOI: 10.3390/jmse6030093
Language: en
Status of Item: Peer reviewed
Appears in Collections:Mechanical & Materials Engineering Research Collection

Show full item record

Google ScholarTM



This item is available under the Attribution-NonCommercial-NoDerivs 3.0 Ireland. No item may be reproduced for commercial purposes. For other possible restrictions on use please refer to the publisher's URL where this is made available, or to notes contained in the item itself. Other terms may apply.