Grade Language Heterogeneity in Simulation Models of Peer Review

Files in This Item:
File Description SizeFormat 
Feliciani ea 2020 - JASSS revision 1 _20200312.pdf886.81 kBAdobe PDFDownload
Title: Grade Language Heterogeneity in Simulation Models of Peer Review
Authors: Feliciani, ThomasMoorthy, RamanathanLucas, PabloShankar, Kalpana
Permanent link:
Date: 30-Jun-2020
Online since: 2021-03-11T13:15:21Z
Abstract: Simulation models have proven to be valuable tools for studying peer review processes. However, the effects of some of these models’ assumptions have not been tested, nor have these models been examined in comparative contexts. In this paper, we address two of these assumptions which go in tandem: (1) on the granularity of the evaluation scale, and (2) on the homogeneity of the grade language (i.e. whether reviewers interpret evaluation grades in the same fashion). We test the consequences of these assumptions by extending a well-known agent-based model of author and reviewer behaviour with discrete evaluation scales and reviewers’ interpretation of the grade language. In this way, we compare a peer review model with a homogeneous grade language, as assumed in most models of peer review, with a more psychologically realistic model where reviewers interpret the grades of the evaluation scale heterogeneously. We find that grade language heterogeneity can indeed affect the predictions of a model of peer review.
Funding Details: Science Foundation Ireland
Type of material: Journal Article
Publisher: University of Surrey
Journal: Journal of Artificial Societies and Social Simulation
Volume: 23
Issue: 3
Copyright (published version): 2020 JASSS
Keywords: Peer reviewGrade languageAgent-based modeling
DOI: 10.18564/jasss.4284
Language: en
Status of Item: Peer reviewed
ISSN: 1460-7425
This item is made available under a Creative Commons License:
Appears in Collections:Information and Communication Studies Research Collection
Sociology Research Collection
Geary Institute Research Collection

Show full item record

Page view(s)

Last Week
Last month
checked on Apr 11, 2021


checked on Apr 11, 2021

Google ScholarTM



If you are a publisher or author and have copyright concerns for any item, please email and the item will be withdrawn immediately. The author or person responsible for depositing the article will be contacted within one business day.