ROC-based Performance Analysis and Interpretation of Image-based Damage Diagnostic Tools for Underwater Inspections

Files in This Item:
File Description SizeFormat 
Paper For Ghent2018.pdf1.21 MBAdobe PDFDownload
Title: ROC-based Performance Analysis and Interpretation of Image-based Damage Diagnostic Tools for Underwater Inspections
Authors: O'Byrne, Michael
Pakrashi, Vikram
Schoefs, Franck
Ghosh, Bidisha
Permanent link: http://hdl.handle.net/10197/10762
Date: 10-Oct-2018
Online since: 2019-06-10T07:59:18Z
Abstract: It is of practical importance for inspectors to have knowledge of the efficiency of Non-Destructive Testing (NDT) tools when applied commercially. It has become common practice to model the performance of NDT tools in a probabilistic manner in terms of Probability of Detection (PoD), Probability of False Alarm (PFA) and eventually by Receiver Operating Characteristic (ROC) Curves. Traditionally, these quantities are estimated from training data, however, there are often doubts about the validity of these estimates when the sample size is small. In the case of underwater inspections, the scarcity of good quality training data means that this scenario arises more often than not. Comprehensive studies around the on-site performance of image-based damage diagnostic tools have only recently been made possible through the availability of online resources such as the Underwater Lighting and Turbidity Image Repository (ULTIR), which contains photographs of various damages forms captured under controlled visibility conditions. This paper shows how meaningful information can be extracted from this repository and used to construct ROC curves that can be related to the on-site performance of image-based NDT methods for detecting various damage forms and under a range of environmental conditions. The ability to draw connections between image-based techniques applied in real underwater inspections with ROC curves that can be constructed on-demand provide the engineer/ inspector with a clear and systematic route for assessing the reliability of data obtained from image-based methods. As a case study, the general approach has been applied to characterise the performance of image-based techniques for identifying instances of corrosion and cracks on marine structures. A discussion around how the results can be used for further analysis is provided. This includes looking at how the results can be fed into in the decision chain and can be used for risk analysis, intervention and work scheduling, and eventually understanding the value of information.
Type of material: Conference Publication
Publisher: Taylor & Francis
Start page: 1679
End page: 1686
Copyright (published version): 2018 Taylor & Francis
Keywords: Non-Destructive Testing (NDT) toolsProbability of Detection (PoD)Probability of False Alarm (PFA)Receiver Operating Characteristic (ROC) CurvesUnderwater Lighting and Turbidity Image Repository (ULTIR)Marine structuresCorrosion
Language: en
Status of Item: Peer reviewed
Is part of: Caspeele, R., Taerwe, L., Frangopol, D.M. (eds.). Life-Cycle Analysis and Assessment in Civil Engineering: Towards an Integrated Vision - Proceedings of the 6th International Symposium on Life-Cycle Civil Engineering, IALCCE 2018
Conference Details: IALCCE 2018, Sixth International Symposium on Life-Cycle Civil Engineering, Ghent, Belgium, 28-31 October 2018
ISBN: 9781138626331
Appears in Collections:Mechanical & Materials Engineering Research Collection

Show full item record

Google ScholarTM

Check

Altmetric


This item is available under the Attribution-NonCommercial-NoDerivs 3.0 Ireland. No item may be reproduced for commercial purposes. For other possible restrictions on use please refer to the publisher's URL where this is made available, or to notes contained in the item itself. Other terms may apply.