Technical assessment and evaluation of environmental models and software : letter to the Editor

Files in This Item:
File Description SizeFormat 
Alexandrov_Bruen et al.pdf256.8 kBAdobe PDFDownload
Title: Technical assessment and evaluation of environmental models and software : letter to the Editor
Authors: Alexandrov, G. A.
Ames, D.
Bellocchi, G.
Bruen, Michael
Crout, N.
Erechtchoukova, M.
Hildebrandt, A.
Hoffman, F.
Jackisch, C.
Khaiter, P.
Mannina, G.
Matsunaga, T.
Purucker, S. T.
Rivington, M.
Samaniego, L.
Permanent link:
Date: Mar-2011
Abstract: This letter details the collective views of a number of independent researchers on the technical assessment and evaluation of environmental models and software. The purpose is to stimulate debate and initiate action that leads to an improved quality of model development and evaluation, so increasing the capacity for models to have positive outcomes from their use. As such, we emphasize the relationship between the model evaluation process and credibility with stakeholders (including funding agencies) with a view to ensure continued support for modelling efforts. Many journals, including EM&S, publish the results of environmental modelling studies and must judge the work and the submitted papers based solely on the material that the authors have chosen to present and on how they present it. There is considerable variation in how this is done with the consequent risk of considerable variation in the quality and usefulness of the resulting publication. Part of the problem is that the review process is reactive, responding to the submitted manuscript. In this letter, we attempt to be proactive and give guidelines for researchers, authors and reviewers as to what constitutes best practice in presenting environmental modelling results. This is a unique contribution to the organisation and practice of model-based research and the communication of its results that will benefit the entire environmental modelling community. For a start, our view is that the community of environmental modellers should have a common vision of minimum standards that an environmental model must meet. A common vision of what a good model should be is expressed in various guidelines on Good Modelling Practice. The guidelines prompt modellers to codify their practice and to be more rigorous in their model testing. Our statement within this letter deals with another aspect of the issue – it prompts professional journals to codify the peer-review process. Introducing a more formalized approach to peer-review may discourage reviewers from accepting invitations to review given the additional time and labour requirements. The burden of proving model credibility is thus shifted to the authors. Here we discuss how to reduce this burden by selecting realistic evaluation criteria and conclude by advocating the use of standardized evaluation tools as this is a key issue that needs to be tackled.
Funding Details: Not applicable
Type of material: Journal Article
Publisher: Elsevier
Copyright (published version): 2010 Elsevier Ltd. All rights reserved.
Keywords: Environmental modellingEnvironmental softwareModel evaluationModel credibilitySoftware verificationEnvironmental assessment
Subject LCSH: Environmental sciences--Computer simulation--Evaluation
Environmental sciences--Software--Evaluation
Environmental impact analysis--Computer simulation--Evaluation
Environmental impact analysis--Software--Evaluation
DOI: 10.1016/j.envsoft.2010.08.004
Language: en
Status of Item: Peer reviewed
Appears in Collections:Centre for Water Resources Research Collection
Urban Institute Ireland Research Collection
Critical Infrastructure Group Research Collection
Civil Engineering Research Collection

Show full item record

Citations 5

Last Week
Last month
checked on Aug 9, 2018

Google ScholarTM



This item is available under the Attribution-NonCommercial-NoDerivs 3.0 Ireland. No item may be reproduced for commercial purposes. For other possible restrictions on use please refer to the publisher's URL where this is made available, or to notes contained in the item itself. Other terms may apply.