A Lite Hierarchical Model for Dialogue Summarization with Multi-Granularity Decoder

dc.contributor.authorZheng, Tong
dc.contributor.authorSaga, Ryosuke
dc.date.accessioned2022-12-27T19:02:41Z
dc.date.available2022-12-27T19:02:41Z
dc.date.issued2023-01-03
dc.description.abstractAbstract dialogue summarization generation has recently attracted considerable research attention, especially in using hierarchical models to accomplish abstract dialogue summarization tasks successfully. However, problems in recent studies often include an excessive amount of model parameters and long training time mainly because existing dialogue summaries of hierarchical models are typically generated by adding extra encoders and attention layers in the decoder to enhance learning and summarization generation ability of the model. Hence, designing an increasingly lightweight hierarchical model is necessary. A lightweight hierarchical model named ALH-BART is proposed in this study to generate high-accuracy dialogue summaries rapidly. The proposed hierarchical model includes word and turn encoders, which enhance the ability of the model to understand dialogue. A multigranularity decoder in the model is also proposed to decode word- and turn-level information in the decoder at the same time. Encoder parameters in multihead self-attention are provided for each corresponding multihead self-attention to reduce the number of model parameters and improve the speed of model learning effectively. Finally, the effectiveness of the model is verified on SAMSum and DialogSum datasets.
dc.format.extent10
dc.identifier.doi10.24251/HICSS.2023.270
dc.identifier.isbn978-0-9981331-6-4
dc.identifier.othera7bd778c-d41b-4320-90e9-59c8e62712f1
dc.identifier.urihttps://hdl.handle.net/10125/102901
dc.language.isoeng
dc.relation.ispartofProceedings of the 56th Hawaii International Conference on System Sciences
dc.rightsAttribution-NonCommercial-NoDerivatives 4.0 International
dc.rights.urihttps://creativecommons.org/licenses/by-nc-nd/4.0/
dc.subjectData Analytics, Data Mining, and Machine Learning for Social Media
dc.subjectdialog/chat summarization
dc.subjecthierarchical model
dc.subjectmachine learning
dc.subjectsocial media
dc.titleA Lite Hierarchical Model for Dialogue Summarization with Multi-Granularity Decoder
dc.type.dcmitext
prism.startingpage2180

Files

Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
0213.pdf
Size:
753.61 KB
Format:
Adobe Portable Document Format