Options
Mixtures of biased sentiment analysers
File(s)
File | Description | Size | Format | |
---|---|---|---|---|
Mixtures of biased sentiment analysers.pdf | 255.83 KB |
Date Issued
31 August 2013
Date Available
10T11:27:17Z July 2019
Abstract
Modelling bias is an important consideration when dealing with inexpert annotations. We are concerned with training a classifier to perform sentiment analysis on news media articles, some of which have been manually annotated by volunteers. The classifier is trained on the words in the articles and then applied to non-annotated articles. In previous work we found that a joint estimation of the annotator biases and the classifier parameters performed better than estimation of the biases followed by training of the classifier. An important question follows from this result: can the annotators be usefully clustered into either predetermined or data-driven clusters, based on their biases? If so, such a clustering could be used to select, drop or otherwise categorise the annotators in a crowdsourcing task. This paper presents work on fitting a finite mixture model to the annotators’ bias. We develop a model and an algorithm and demonstrate its properties on simulated data. We then demonstrate the clustering that exists in our motivating dataset, namely the analysis of potentially economically relevant news articles from Irish online news sources.
Type of Material
Journal Article
Publisher
Springer
Journal
Advances in Data Analysis and Classification
Volume
8
Issue
1
Start Page
85
End Page
103
Copyright (Published Version)
2013 Springer-Verlag Berlin Heidelberg
Language
English
Status of Item
Peer reviewed
ISSN
1862-5347
This item is made available under a Creative Commons License
Owning collection
Scopus© citations
3
Acquisition Date
Mar 27, 2023
Mar 27, 2023
Views
743
Acquisition Date
Mar 27, 2023
Mar 27, 2023
Downloads
233
Acquisition Date
Mar 27, 2023
Mar 27, 2023