Training a Chatbot with Microsoft LUIS: Effect of Intent Imbalance on Prediction Accuracy
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
IUI_Intent_Imbalance_LUIS (1).pdf | 395.11 kB | Adobe PDF | Download |
Title: | Training a Chatbot with Microsoft LUIS: Effect of Intent Imbalance on Prediction Accuracy | Authors: | Ruane, Elayne; Young, Robert; Ventresque, Anthony | Permanent link: | http://hdl.handle.net/10197/11782 | Date: | 17-Mar-2020 | Online since: | 2020-12-04T12:42:55Z | Abstract: | Microsoft LUIS is a natural language understanding service used to train Chatbots. Imbalance in the utterance training set may cause the LUIS model to predict the wrong intent for a user's query. We discuss this problem and the training recommendations from Microsoft to improve prediction accuracy with LUIS. We perform batch testing on three training sets created from two existing datasets to explore the effectiveness of these recommendations. | Funding Details: | Science Foundation Ireland | Funding Details: | Microsoft Corporation | Type of material: | Conference Publication | Publisher: | ACM | Copyright (published version): | 2020 the Authors | Keywords: | Dataset imbalance; Chatbot; LUIS; Classification accuracy | DOI: | 10.1145/3379336.3381494 | Other versions: | http://iui.acm.org/2020/ | Language: | en | Status of Item: | Peer reviewed | Is part of: | IUI '20: Proceedings of the 25th International Conference on Intelligent User Interfaces Companion | Conference Details: | The 25th International Conference on Intelligent User Interfaces Companion (IUI'20), Cagliari, Italy, 17-20 March 2020 | ISBN: | 9781450375139 978-1-4503-7513-9 |
This item is made available under a Creative Commons License: | https://creativecommons.org/licenses/by-nc-nd/3.0/ie/ |
Appears in Collections: | Computer Science Research Collection |
Show full item record
Page view(s)
126
Last Week
6
6
Last month
checked on Jan 16, 2021
Download(s)
19
checked on Jan 16, 2021
Google ScholarTM
Check
Altmetric
If you are a publisher or author and have copyright concerns for any item, please email research.repository@ucd.ie and the item will be withdrawn immediately. The author or person responsible for depositing the article will be contacted within one business day.