Stability of topic modeling via matrix factorization

Files in This Item:
Access to this item has been restricted by the copyright holder until:2019-09-01
File Description SizeFormat 
insight_publication.pdf335.66 kBAdobe PDFDownload    Request a copy
Title: Stability of topic modeling via matrix factorization
Authors: Belford, Mark
MacNamee, Brian
Greene, Derek
Permanent link:
Date: Jan-2017
Abstract: Topic models can provide us with an insight into the underlying latent structure of a large corpus of documents. A range of methodshave been proposed in the literature, including probabilistic topic models and techniques based on matrix factorization. However, inboth cases, standard implementations rely on stochastic elements in their initialization phase, which can potentially lead to differentresults being generated on the same corpus when using the same parameter values. This corresponds to the concept of instabilitywhich has previously been studied in the context of k-means clustering. In many applications of topic modeling, this problem ofinstability is not considered and topic models are treated as being definitive, even though the results may change considerably if theinitialization process is altered. In this paper we demonstrate the inherent instability of popular topic modeling approaches, usinga number of new measures to assess stability. To address this issue in the context of matrix factorization for topic modeling, wepropose the use of ensemble learning strategies. Based on experiments performed on annotated text corpora, we show that a K-Foldensemble strategy, combining both ensembles and structured initialization, can significantly reduce instability, while simultaneouslyyielding more accurate topic models
Funding Details: Science Foundation Ireland
Type of material: Journal Article
Publisher: Elsevier
Journal: Expert Systems with Applications
Volume: 91
Start page: 159
End page: 169
Copyright (published version): 2018 Elsevier
Keywords: Topic modelingTopic stabilityLDANMF
DOI: 10.1016/j.eswa.2017.08.047
Language: en
Status of Item: Peer reviewed
Appears in Collections:Insight Research Collection

Show full item record

Citations 50

Last Week
Last month
checked on Nov 12, 2018

Google ScholarTM



This item is available under the Attribution-NonCommercial-NoDerivs 3.0 Ireland. No item may be reproduced for commercial purposes. For other possible restrictions on use please refer to the publisher's URL where this is made available, or to notes contained in the item itself. Other terms may apply.