MULTIMODAL ANALYSIS: THE PERFORMATIVITY OF SHORT-FORM VIDEOS AND THEIR AFFORDANCES
Date
2024
Authors
Contributor
Advisor
Department
Instructor
Depositor
Speaker
Researcher
Consultant
Interviewer
Narrator
Transcriber
Annotator
Journal Title
Journal ISSN
Volume Title
Publisher
Volume
Number/Issue
Starting Page
Ending Page
Alternative Title
Abstract
With short-form videos being ubiquitous, making sense of their performativity as well as the potential relationship (affordances) between people and short videos are imperative. Studies of social media from a performative perspective are increasing. However, two aspects are yet to be updated: a robust research method to study the emerging visual phenomenon, and a holistic system to explain short-form videos. Multimodal analysis, a method that pays attention to visual sense-making, comes in handy for researching visual and media literacy.
Previous peer-reviewed and published pilot studies showed that short-form videos are theatrical. Building on this, this dissertation probes further, with a broader frame of reference that is performative, to understand the interactions between technology and people. The objective of this qualitative study was to study how the design of short video apps impacts people's creation, and the performative activities afforded by the platform. The goal is to enrich media literacy through multimodal communication.
This research asks three questions: What affordances do short-form videos as a medium offer? How do users use these affordances in user-generated short-videos to create a performance? Among different communicative forms, do users’ use of affordances differ? Using walkthroughs, multimodal analysis, and several procedures from grounded theory, I explored how affordances of short-form videos are multi-layered, and the relationships between the layers.
The results revealed 5 performative devices, 3 steps of video analysis, and 2 techniques to apply when determining modes. Results demonstrated three layers of affordances reflected by modes such as facial expressions (low-level); spatial relationships (intermediate level); and five performative devices (high-level). Results also suggest that behaviors of performativity are universal across three platforms, and that many principles applicable in still images work the same in short videos.
The findings contribute to both the method level and the theory level of digital sense-making and media literacy. The dissertation adds onto ways of looking at short videos effectively and informs creators and users ways their creations can be looked at. It connects with the current discourse of disinformation and misinformation, the harm “harmless” humor can make, and media multitasking issues. As interdisciplinary research, this study bridges disciplines and contributes to the fields of media and communication studies, performance studies, and human computer interaction.
Description
Keywords
Communication, Information science, affordances, multimodal analysis, performative, short-form videos, social media
Citation
Extent
159 pages
Format
Geographic Location
Time Period
Related To
Related To (URI)
Table of Contents
Rights
All UHM dissertations and theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission from the copyright owner.
Rights Holder
Local Contexts
Email libraryada-l@lists.hawaii.edu if you need this content in ADA-compliant format.