A scoping review of simulation models of peer review

Files in This Item:
File Description SizeFormat 
Feliciani ea 2019 - Revised scientometrics submission (1).docx139.9 kBUnknownDownload
Title: A scoping review of simulation models of peer review
Authors: Feliciani, ThomasLuo, JunwenMa, LaiLucas, PabloShankar, Kalpanaet al.
Permanent link: http://hdl.handle.net/10197/11042
Date: 19-Aug-2019
Online since: 2019-08-26T14:21:35Z
Abstract: Peer review is a process used in the selection of manuscripts for journal publication and proposals for research grant funding. Though widely used, peer review is not without flaws and critics. Performing large-scale experiments to evaluate and test correctives and alternatives is difficult, if not impossible. Thus, many researchers have turned to simulation studies to overcome these difficulties. In the last ten years this field of research has grown significantly but with only limited attempts to integrate disparate models or build on previous work. Thus, the resulting body of literature consists of a large variety of models, hinging on incompatible assumptions, which have not been compared, and whose predictions have rarely been empirically tested. This scoping review is an attempt to understand the current state of simulation studies of peer review. Based on 46 articles identified through literature searching, we develop a proposed taxonomy of model features that include model type (e.g. formal models vs. ABMs or other) and the type of modeled peer review system (e.g. peer review in grants vs. in journals or other). We classify the models by their features (including some core assumptions) to help distinguish between the modeling approaches. Finally, we summarize the models’ findings around six general themes: decision-making, matching submissions/reviewers, editorial strategies; reviewer behaviors, comparisons of alternative peer review systems, and the identification and addressing of biases. We conclude with some open challenges and promising avenues for future modeling work.
Funding Details: Science Foundation Ireland
Type of material: Journal Article
Publisher: Springer Science and Business Media LLC
Journal: Scientometrics
Start page: 1
End page: 40
Copyright (published version): 2019 the Authors
Keywords: Peer reviewSimulationAgent-based modelingJournal editingResearch funding
DOI: 10.1007/s11192-019-03205-w
Language: en
Status of Item: Peer reviewed
Appears in Collections:Information and Communication Studies Research Collection
Sociology Research Collection
Geary Institute Research Collection

Show full item record

Google ScholarTM



This item is available under the Attribution-NonCommercial-NoDerivs 3.0 Ireland. No item may be reproduced for commercial purposes. For other possible restrictions on use please refer to the publisher's URL where this is made available, or to notes contained in the item itself. Other terms may apply.