Training IBM Watson Using Automatically Generated Question-Answer Pairs

Simple item page
dc.contributor.authorLee, Jangho
dc.contributor.authorKim, Gyuwan
dc.contributor.authorYoo, Jaeyoon
dc.contributor.authorJung, Changwoo
dc.contributor.authorKim, Minseok
dc.contributor.authorYoon, Sungroh
dc.date.accessioned2016-12-29T00:42:03Z
dc.date.available2016-12-29T00:42:03Z
dc.date.issued2017-01-04
dc.description.abstractIBM Watson is a cognitive computing system capable of question answering in natural languages. It is believed that IBM Watson can understand large corpora and answer relevant questions more effectively than any other question-answering system currently available. To unleash the full power of Watson, however, we need to train its instance with a large number of well-prepared question-answer pairs. Obviously, manually generating such pairs in a large quantity is prohibitively time consuming and significantly limits the efficiency of Watson’s training. Recently, a large-scale dataset of over 30 million question-answer pairs was reported. Under the assumption that using such an automatically generated dataset could relieve the burden of manual question-answer generation, we tried to use this dataset to train an instance of Watson and checked the training efficiency and accuracy. According to our experiments, using this auto-generated dataset was effective for training Watson, complementing manually crafted question-answer pairs. To the best of the authors’ knowledge, this work is the first attempt to use a large-scale dataset of automatically generated question-answer pairs for training IBM Watson. We anticipate that the insights and lessons obtained from our experiments will be useful for researchers who want to expedite Watson training leveraged by automatically generated question-answer pairs.
dc.format.extent9 pages
dc.identifier.doi10.24251/HICSS.2017.203
dc.identifier.isbn978-0-9981331-0-2
dc.identifier.urihttp://hdl.handle.net/10125/41356
dc.language.isoeng
dc.relation.ispartofProceedings of the 50th Hawaii International Conference on System Sciences
dc.rightsAttribution-NonCommercial-NoDerivatives 4.0 International
dc.rights.urihttps://creativecommons.org/licenses/by-nc-nd/4.0/
dc.subjectCognitive Computing
dc.subjectMachine Learning
dc.subjectData Mining
dc.subjectNatural Language Processing
dc.subjectQuestion Answering System
dc.titleTraining IBM Watson Using Automatically Generated Question-Answer Pairs
dc.typeConference Paper
dc.type.dcmiText

Files

Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
paper0207.pdf
Size:
1.17 MB
Format:
Adobe Portable Document Format
Download

Collections

Smart Service Systems: Analytics, Cognition and Innovation Minitrack