Enhancing User Behavior Modeling via Machine Learning with Combined Text and Image Data

Date

2024-01-03

Contributor

Advisor

Department

Instructor

Depositor

Speaker

Researcher

Consultant

Interviewer

Narrator

Transcriber

Annotator

Journal Title

Journal ISSN

Volume Title

Publisher

Volume

Number/Issue

Starting Page

2495

Ending Page

Alternative Title

Abstract

Existing works typically operate on either image or text data from social media, but rarely work with both content types simultaneously. We propose and validate a technique for combining image and text data for predicting user engagement metrics based on social media data. We collected image and text data from 366,415 Facebook posts and a respective 1,305,375 million comments. The combined model achieves a 3.5x improvement in mean squared error when predicting share count and a 14% improvement for comment sentiment over single data type models. Finally, the study demonstrates the ability to pick more performant advertisement out of 16.7 billion pairs; the resulting machine learning models successfully predicts for a greater comment sentiment, comment count, and share count 93%, 65%, and 63% of the time.

Description

Keywords

Data Analytics, Data Mining, and Machine Learning for Social Media, advertisements, deep neural networks, ensemble models, machine learning, social media

Citation

Extent

10 pages

Format

Geographic Location

Time Period

Related To

Proceedings of the 57th Hawaii International Conference on System Sciences

Related To (URI)

Table of Contents

Rights

Attribution-NonCommercial-NoDerivatives 4.0 International

Rights Holder

Local Contexts

Email libraryada-l@lists.hawaii.edu if you need this content in ADA-compliant format.