Text vs. Image: An application of unsupervised multi-modal machine learning to online reviews

dc.contributor.authorMestri, Rohan
dc.contributor.authorBollam, Pragna
dc.contributor.authorOvergoor, Gijs
dc.contributor.authorRand, William
dc.date.accessioned2021-12-24T18:00:29Z
dc.date.available2021-12-24T18:00:29Z
dc.date.issued2022-01-04
dc.description.abstractOnline user-generated reviews provide a unique view into consumer perceptions of a business. Extant research has demonstrated that text mining provides insight from textual reviews. More recently, we haven seen the adoption of image mining techniques to analyze visual content as well. With data comprising of user-generated imagery (UGI) and textual reviews, we propose to perform a combination of text- and image mining techniques to extract relevant attributes from both modalities. The analysis allows for a comparison between textual and visual content in online reviews. For the UGI analysis, we use a Deep Embedded Clustering model and for the User Generated Text Analysis we use a TF-IDF based mechanism to obtain attributes and polarities. The overall goal is to extract maximum information from text and images and compare the insights we gather from both. We analyze if any modality is self-sufficient or better than the other and also if both modalities combine to give similar or contrasting insights.
dc.format.extent10 pages
dc.identifier.doi10.24251/HICSS.2022.555
dc.identifier.isbn978-0-9981331-5-7
dc.identifier.urihttp://hdl.handle.net/10125/79892
dc.language.isoeng
dc.relation.ispartofProceedings of the 55th Hawaii International Conference on System Sciences
dc.rightsAttribution-NonCommercial-NoDerivatives 4.0 International
dc.rights.urihttps://creativecommons.org/licenses/by-nc-nd/4.0/
dc.subjectElectronic Marketing
dc.subjectmachine learning
dc.subjectdeep learning
dc.subjectonline reviews
dc.subjecttext mining
dc.subjectimage mining
dc.subjecte-commerce
dc.subjectmarketing
dc.titleText vs. Image: An application of unsupervised multi-modal machine learning to online reviews
dc.type.dcmitext

Files

Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
0448.pdf
Size:
1.18 MB
Format:
Adobe Portable Document Format