Predicting Question Deletion and Assessing Question Quality in Social Q&A Sites using Weakly Supervised Deep Neural Networks

Simple item page
dc.contributor.author Ghosh, Souvick
dc.date.accessioned 2020-12-24T19:32:58Z
dc.date.available 2020-12-24T19:32:58Z
dc.date.issued 2021-01-05
dc.description.abstract Community question answering (CQA) sites, which use the power of collective knowledge, have emerged as popular destinations for complex and personalized questions that require human-human interactions and multiple rounds of clarifications between the asker and the answerer. In this paper, we undertook a threefold task: First, we developed a deep neural network model to automatically predict the questions that are likely to be deleted by the moderators. Second, we hypothesized that there exists a relationship between the question quality and its probability of being deleted by the forum moderators. We developed a deep model using deleted questions and used it for predicting question quality. Our contribution is not limited to developing the predictor model; we also created the gold standard data for question quality assessment. Lastly, we explored the efficiency of different input representations, optimization functions, and neural network models for predicting question quality. When assessing question quality, the results highlight that combining natural language features with word embeddings can result in better performance (higher recall and f-scores) than word embeddings alone. Our model predicted deleted-questions with an accuracy of 97.8% and precision and true positive rates (TPR) above 0.95. While assessing question quality, our model obtained a TPR of 0.841 and a precision of 0.514. This research serves as the first step toward automatic content moderation in CQA sites; identifying poor quality questions would allow askers to improve the quality of questions asked and the moderators to handle a large volume of questions during content moderation.
dc.format.extent 10 pages
dc.identifier.doi 10.24251/HICSS.2021.329
dc.identifier.isbn 978-0-9981331-4-0
dc.identifier.uri http://hdl.handle.net/10125/70943
dc.language.iso English
dc.relation.ispartof Proceedings of the 54th Hawaii International Conference on System Sciences
dc.rights Attribution-NonCommercial-NoDerivatives 4.0 International
dc.rights.uri https://creativecommons.org/licenses/by-nc-nd/4.0/
dc.subject Data Analytics, Data Mining and Machine Learning for Social Media
dc.subject automatic prediction
dc.subject deep learning
dc.subject question-answering forums
dc.subject question deletion
dc.subject question quality
dc.title Predicting Question Deletion and Assessing Question Quality in Social Q&A Sites using Weakly Supervised Deep Neural Networks
prism.startingpage 2699
Files
Original bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
0264.pdf
Size:
263.51 KB
Format:
Adobe Portable Document Format
Description:
Download
Collections
Data Analytics, Data Mining and Machine Learning for Social Media