Options
Distortion as a validation criterion in the identification of suspicious reviews
Date Issued
2010-05-02
Date Available
2010-05-10T15:56:44Z
Abstract
Assessing the trustworthiness of reviews is a key issue for the maintainers of opinion sites such as TripAdvisor. In this paper we propose a distortion criterion for assessing the impact of methods for uncovering suspicious hotel reviews in TripAdvisor. The principle is that dishonest reviews will distort the overall popularity ranking for a collection of hotels. Thus a mechanism that deletes dishonest reviews will distort the popularity ranking significantly, when compared with the removal of a similar set of reviews at random. This distortion can be quantified by comparing popularity rankings before and after deletion, using rank correlation. We present an evaluation of this strategy in the assessment of shill detection mechanisms on a dataset of hotel reviews collected from TripAdvisor.
Sponsorship
Science Foundation Ireland
Type of Material
Technical Report
Publisher
University College Dublin. School of Computer Science and Informatics
Series
UCD CSI Technical Reports
UCD-CSI-2010-04
Subject – LCSH
User-generated content--Evaluation
Recommender systems (Information filtering)--Evaluation
Language
English
Status of Item
Not peer reviewed
This item is made available under a Creative Commons License
File(s)
Owning collection
Views
1904
Acquisition Date
Mar 27, 2024
Mar 27, 2024
Downloads
1217
Acquisition Date
Mar 27, 2024
Mar 27, 2024