Accuracy evaluation of methods and techniques in Web-based question answering systems: a survey
Document Type
Article
Publication Date
1-1-2019
Abstract
Question answering (QA) systems answer the queries of users efficiently in the least amount of time. A researcher has to decide which among various methods and techniques available will be used to retrieve accurate answers when developing a QA system. This step creates an overhead before making a selection.The study highlights the methods and techniques that perform well in terms of the accuracy of answers provided. Nine Web-based question answering systems were consulted, and the applied methods and techniques evaluated on the basis of the percentage of questions correctly answered and the mean reciprocal rank evaluation measures. Results were discussed using three key stages involved in a QA system: answer extraction, scoring of answers, and answer aggregation. Results show some techniques have higher accuracy of answers than others. Not all methods in QA systems can improve the accuracy of answers individually, but the methods used in combination obtain greater effect. The results can be used to select methods and techniques optimal for producing highly accurate scores without spending time on benchmarking. © 2018, Springer-Verlag London Ltd., part of Springer Nature.
Keywords
Answer accuracy, Answer retrieval methods, Information retrieval, Natural language processing, Question answering systems
Divisions
FLL
Funders
UMRG Programme RP059A-17SBS from Universiti Malaya and the Ministry of Higher Education, Malaysia
Publication Title
Knowledge and Information Systems
Volume
58
Issue
3
Publisher
Springer Verlag