Distortion as a validation criterion in the identification of suspicious reviews

Files in This Item:
File Description SizeFormat 
ucd-csi-2010-04.pdf664.29 kBAdobe PDFDownload
Title: Distortion as a validation criterion in the identification of suspicious reviews
Authors: Wu, Guangyu
Greene, Derek
Smyth, Barry
Cunningham, Pádraig
Permanent link: http://hdl.handle.net/10197/1949
Date: 2-May-2010
Abstract: Assessing the trustworthiness of reviews is a key issue for the maintainers of opinion sites such as TripAdvisor. In this paper we propose a distortion criterion for assessing the impact of methods for uncovering suspicious hotel reviews in TripAdvisor. The principle is that dishonest reviews will distort the overall popularity ranking for a collection of hotels. Thus a mechanism that deletes dishonest reviews will distort the popularity ranking significantly, when compared with the removal of a similar set of reviews at random. This distortion can be quantified by comparing popularity rankings before and after deletion, using rank correlation. We present an evaluation of this strategy in the assessment of shill detection mechanisms on a dataset of hotel reviews collected from TripAdvisor.
Funding Details: Science Foundation Ireland
Type of material: Technical Report
Publisher: University College Dublin
Series/Report no.: UCD CSI Technical Reports; UCD-CSI-2010-04
Keywords: User generated contentCredibilityShilling
Subject LCSH: User-generated content--Evaluation
Recommender systems (Information filtering)--Evaluation
Other versions: http://www.csi.ucd.ie/content/distortion-validation-criterion-identification-suspicious-reviews
Language: en
Status of Item: Not peer reviewed
Appears in Collections:Computer Science Research Collection

Show full item record

Page view(s) 5

checked on May 25, 2018

Download(s) 10

checked on May 25, 2018

Google ScholarTM


This item is available under the Attribution-NonCommercial-NoDerivs 3.0 Ireland. No item may be reproduced for commercial purposes. For other possible restrictions on use please refer to the publisher's URL where this is made available, or to notes contained in the item itself. Other terms may apply.