How to evaluate ex ante impact? An analysis of reviewers’ comments on impact statements in grant applications
Files in This Item:
|Request a copy||ex-ante impact_preprint.pdf||1.24 MB||Adobe PDF|
|Title:||How to evaluate ex ante impact? An analysis of reviewers’ comments on impact statements in grant applications||Authors:||Ma, Lai; Luo, Junwen; Feliciani, Thomas; Shankar, Kalpana||Permanent link:||http://hdl.handle.net/10197/12988||Date:||1-Oct-2020||Online since:||2022-07-11T10:50:32Z||Abstract:||Impact statements are increasingly required and assessed in grant applications. In this study, we used content analysis to examine the ‘comments on impact’ section of the postal reviews and related documents of Science Foundation Ireland’s Investigators’ Programme to understand reviewers’ ex ante impact assessment. We found three key patterns: (1) reviewers favoured short-term, tangible impacts, particularly commercial ones; (2) reviewers commented on process-oriented impact (formative) in a more concrete and elaborate manner than on outcome-oriented impact (summative); and (3) topics related to scientific impacts were widely discussed even though the impact section was to be used for evaluating economic and societal impacts. We conclude that for ex ante impact assessment to be effective, funding agencies should indicate the types of impact expected from research proposals clearly instead of a general ‘wish list’ and that more focus should be put on process-oriented impact than outcome-oriented impact.||Funding Details:||Science Foundation Ireland||Type of material:||Journal Article||Publisher:||Oxford University Press||Journal:||Research Evaluation||Volume:||29||Issue:||4||Start page:||431||End page:||440||Copyright (published version):||2020 the Authors||Keywords:||Public universities; Funding agencies; Research impact assessment; Grant applications; Paradoxicality||DOI:||10.1093/reseval/rvaa022||Language:||en||Status of Item:||Peer reviewed||ISSN:||0958-2029||This item is made available under a Creative Commons License:||https://creativecommons.org/licenses/by-nc-nd/3.0/ie/|
|Appears in Collections:||Information and Communication Studies Research Collection|
Show full item record
If you are a publisher or author and have copyright concerns for any item, please email email@example.com and the item will be withdrawn immediately. The author or person responsible for depositing the article will be contacted within one business day.