ROC-based Performance Analysis and Interpretation of Image-based Damage Diagnostic Tools for Underwater Inspections
|Title:||ROC-based Performance Analysis and Interpretation of Image-based Damage Diagnostic Tools for Underwater Inspections||Authors:||O'Byrne, Michael
|Permanent link:||http://hdl.handle.net/10197/10762||Date:||10-Oct-2018||Online since:||2019-06-10T07:59:18Z||Abstract:||It is of practical importance for inspectors to have knowledge of the efficiency of Non-Destructive Testing (NDT) tools when applied commercially. It has become common practice to model the performance of NDT tools in a probabilistic manner in terms of Probability of Detection (PoD), Probability of False Alarm (PFA) and eventually by Receiver Operating Characteristic (ROC) Curves. Traditionally, these quantities are estimated from training data, however, there are often doubts about the validity of these estimates when the sample size is small. In the case of underwater inspections, the scarcity of good quality training data means that this scenario arises more often than not. Comprehensive studies around the on-site performance of image-based damage diagnostic tools have only recently been made possible through the availability of online resources such as the Underwater Lighting and Turbidity Image Repository (ULTIR), which contains photographs of various damages forms captured under controlled visibility conditions. This paper shows how meaningful information can be extracted from this repository and used to construct ROC curves that can be related to the on-site performance of image-based NDT methods for detecting various damage forms and under a range of environmental conditions. The ability to draw connections between image-based techniques applied in real underwater inspections with ROC curves that can be constructed on-demand provide the engineer/ inspector with a clear and systematic route for assessing the reliability of data obtained from image-based methods. As a case study, the general approach has been applied to characterise the performance of image-based techniques for identifying instances of corrosion and cracks on marine structures. A discussion around how the results can be used for further analysis is provided. This includes looking at how the results can be fed into in the decision chain and can be used for risk analysis, intervention and work scheduling, and eventually understanding the value of information.||Type of material:||Conference Publication||Publisher:||Taylor & Francis||Start page:||1679||End page:||1686||Copyright (published version):||2018 Taylor & Francis||Keywords:||Non-Destructive Testing (NDT) tools; Probability of Detection (PoD); Probability of False Alarm (PFA); Receiver Operating Characteristic (ROC) Curves; Underwater Lighting and Turbidity Image Repository (ULTIR); Marine structures; Corrosion||Language:||en||Status of Item:||Peer reviewed||Is part of:||Caspeele, R., Taerwe, L., Frangopol, D.M. (eds.). Life-Cycle Analysis and Assessment in Civil Engineering: Towards an Integrated Vision - Proceedings of the 6th International Symposium on Life-Cycle Civil Engineering, IALCCE 2018||Conference Details:||IALCCE 2018, Sixth International Symposium on Life-Cycle Civil Engineering, Ghent, Belgium, 28-31 October 2018||ISBN:||9781138626331|
|Appears in Collections:||Mechanical & Materials Engineering Research Collection|
Show full item record
This item is available under the Attribution-NonCommercial-NoDerivs 3.0 Ireland. No item may be reproduced for commercial purposes. For other possible restrictions on use please refer to the publisher's URL where this is made available, or to notes contained in the item itself. Other terms may apply.