LTEC 690, Spring 2021

Permanent URI for this collectionhttps://hdl.handle.net/10125/75519

Browse

Now showing 1 - 20 of 21

Evaluating a Mobile-based Genetics Learning Platform in K-12 Educators Teaching After-School Programs
(2020-05-07) Bernal, Saul; Fulford, Catherine
This project was a usability study which included the prototyping and the evaluation of a mobile-based genetics learning platform designed for K-12 students and educators. The target audience was K-12 educators teaching the after-school programs. In the development phase, a mobile-based application was developed using the integrated development environment Xcode. The content of the application included mini-learning games developed by the investigator and open-source educational videos. The purpose of this study was to prototype and evaluate the user-friendliness of the developed mobile-platform. In the evaluation stage, individual iterations of the usability test of the mobile-based app were conducted per participant. The participants for each round consisted of educators who are currently or previously have taught after-school programs. Prior to the usability test, participants were asked to sign a consent form. A pre-survey was administered after each student was cleared to participate. During the usability test, each subject was asked to complete five tasks on the mobile-based app. Following the completion of the tasks, the participants answered a post-task survey. Screen user-activity and audio was recorded, anonymized, and stored on an encrypted-protected hard drive for consequent data analysis.
A Usability Study of a Community College's Testing Center Website
(2021-05-10) Lum, Jessica; Hoffman, Daniel
The purpose of this project was to design and evaluate a website for a testing center at students at a community college in Hawaiʻi. To design the website, the researcher applied principles of user-centered design to ensure the target audience—community college students—would be able to find information about the testing center quickly and easily. Using Gestalt principles, the website was designed to work to help students by being functional and user-friendly. To evaluate the website, a usability study was conducted with 18 (n = 18) college-aged adults. During the study, the participants completed three usability tasks designed to measure the website’s usability. Specifically, the study evaluated if the participants found the site to be navigable, satisfying, and interesting. The usability study evaluates the participants’ navigation, satisfaction, and interest. Data were collected through questionnaires and think aloud sessions. The results suggests that the new website was easy to navigate, satisfied with the content, and interested in using the website.
Statistical Literacy for Educators: Usability Study
(2021-04-15) Egorov, Dmitrii; Fulford, Catherine
The role of data in many fields and areas of modern life is significant. Gathering, shaping, storing, and analyzing data is becoming a very important industry. This importance of data analysis implies that even people who are not employed in analytic positions would benefit from understanding at least basic concepts of data analysis. This fact increases demand in statistical literacy, especially for those who are dealing with data during their workflow. Educators, and especially teachers are among those who collect data from their students and might benefit from understanding the basic principles of statistics. This project aimed to develop and evaluate an online based resource where basic statistical concepts are paralleled with scenarios of their use in a classroom. The usability study explored ease of use of the website and satisfaction rate of the content presented on the website. The usability study confirmed the need in a resource introducing basic statistical concepts in a simple and highly approachable manner for those employed in the field of education. At the same time, it revealed that simplicity shouldn’t be extreme, and the resource should take advantage of modern web-tools, thus keeping a good balance between accessibility and functionality.
The Sensemaking Model for Airline Pilot Training: Building and Maintaining Expert Flight Path Management
(2021-04-15) Baron Jr, Barth; Fulford, Catherine
Abstract: Airline flight training focuses on the pilot who is flying the airplane, leaving the other pilot in the two-pilot flight deck to independently develop crew-oriented flight path monitoring strategies. Lapses in monitoring can lead to incidents and accidents when crews misinterpret the aircraft’s state and mismanage flight automation systems. To address this, NASA human factors researchers developed a monitoring framework based on the organizational psychology concept of “sensemaking.” This approach teaches crews to monitor their flight path through a three-part process of; 1) develop a situation model, 2) manage tasks and attention to more efficiently allocate attention resources, and 3) communicate effectively as a crew. An asynchronous learning module using task-based learning and design for motivation introduced this sensemaking monitoring framework to airline pilots. Twenty participants used the module and answered survey questions measuring the effectiveness of design for motivation and task-based learning. The pilots responded favorably to the design, with positive survey responses for relevance, integration, and acceptance.
Evaluating an Online Module: Using Social Media as a Professional Development Tool for Graduate Students in the Learning Design and Technology Department at the University of Hawaiʻi at Mānoa
(2021-05-13) Nakamura, Elle; Fulford, Catherine
The Learning Design and Technology (LTEC) program at the University of Hawaiʻi at Mānoa focuses on integrating and evaluating educational technology in various learning environments. With the increase of online technologies, social media can be utilized as a professional tool to connect, network, and collaborate with peers, colleagues, and other professionals, especially within the professional world of learning design and development. Currently, the LTEC Department has yet to provide instruction and guidance for LTEC graduate students on why and how to use social media effectively for professional purposes. The purpose of this learning assessment is to evaluate the impact of the online module on the interest and willingness of LTEC graduate students to use social media as a professional development tool within and beyond the LTEC Department. The project was designed using Krathwohl’s Affective Domain Taxonomy and the Keller’s ARCS Model and tested through asynchronous retrospective surveys and one-on-one interviews. Results show a positive change in interest and willingness to utilize social media to for professional purposes within and beyond the LTEC Department. Recommendations for further research include implementing higher level educational objectives, incorporating active participation strategies to observe behavior changes, and widening the target audience to encourage cross-departmental buy-in.
A Curated Wiki for Technical Resources
(2021) Gonsalves, Michael L.; Fulford, Catherine
The purpose of this web design project and usability study is to improve the process of obtaining technical resources and assistance for the faculty, students, researchers, and staff of the Atmospheric Sciences Department of UH Manoa. The researcher, an IT Specialist and the maintainer of the Departmental website, designed and implemented the technology wiki that provides the needed information. A wiki is a specialized collection of web pages that serves as a valuable tool to support the learning community and learning organizations. The wiki contains a knowledgebase of information about technical resources available to the Atmospheric Sciences Department. The wiki knowledgebase grows organically with input from the members of the Department and the curation of the IT Specialist. The wiki is a repository of institutional knowledge for the Atmospheric Sciences Department. The project leans heavily on asynchronous and multimedia learning theory. The wiki was evaluated by a usability study to determine its effectiveness and suggest improvements. The participants in the usability study were members of the Atmospheric Sciences Department. They responded to a usability survey and participated in usability interviews that found the wiki to be useful, helpful, and easy to navigate. Forty percent of the survey respondents said they felt less frustrated and/or confused about obtaining technical resources because the wiki is now available.
ONLINE ORIENTATION EXPERIENCE FOR INCOMING HEALTH INFORMATION TECHNOLOGY STUDENTS AT LEEWARD CC
(2021-05-10) Cashman, Kathleen; Fulford, Catherine P. (instructor)
The Health Information Technology (HIT) profession offers a variety of administrative positions in healthcare. Leeward Community College (Leeward CC) is the only accredited HIT program in the state of Hawai'i. The program is a 2-year degree specializing in HIT. This project aimed to create an orientation experience website for incoming HIT students at Leeward CC. The website was created using WIX, a cloud-based web deployment service, YouTube videos, and customized LOOM videos, with resources and networking links directly related to the HIT program. Based on the Cognitive Theory of Multimedia Learning and the Attention Relevance, Confidence, Satisfaction (ARCS) Model of Motivational Design (Keller,1984), this site was designed to capture the viewer's attention. This study involved fifteen participants (ages 18 to 85). Through pre-screening, data was collected using questionnaires, exit surveys, and testing. After the first two rounds of usability tests, data was analyzed, and the site's revisions were made according to Neilson's Severity Rating scale. The investigator’s goals were to improve the ease of use, quality of content, and navigation of the site. The investigator's personal vested interest in the HIT program and the participants' enthusiasm led to a positive response to the project.
Design Building Blocks: A Usability Study on an Introduction to Commercial Graphic Design Website
(2020-05-09) Dela Cruz, Christian Charles; Fulford, Catherine
It is crucial for college students pursuing a degree in the graphic design-related field to get as much work experience to help them in their professional work post-graduation. Thus, there is a need to substantially provide graphic design training for students interested in a graphic design position or are currently in one. To meet the needs of these individuals who are pursuing student graphic design positions, the researcher created an online asynchronous module. This online website, Design Building Blocks, provides training in four introductory sections: research & imagery, composition & layout, typography, and color. This usability study measures the navigability and organization of the site and the usefulness of the content. Three iterations of testing occurred with participants and qualitative analysis of information received from the study helped benefit any learning strategies and future modifications to the site.
Learning About Online Geometry Resources: A Usability Study on Website for McKinley High School Teachers
(2021-05-07) Matsubara, Shuko; Hoffman, Daniel
Math courses are major classes in high school and are often required for graduation. Geometry is one of the math courses required for graduation and it is crucial for students to pass this course in order to graduate on time. However, in some high school geometry classes with more than 30 students, there are some students who struggle to grasp the content. To facilitate student learning in geometry, teachers should accommodate students by using 21st century skills and providing more visual aid with animations. However, teachers need to be interested and know how to use these resources before presenting them to their students. The researcher utilized learning principles and visual design to develop an informational website about online geometry resources. The website targeted high school geometry teachers. After building the website, the researcher conducted three rounds of usability testing to evaluate ease of use and level of interest. The researcher collected data from 13 participants (n = 13) as they thought aloud about the website, completed four task-based scenarios, and completed surveys. The results from the usability study and the surveys indicated that participants found the website easy to use and helpful. The final product could be shared among geometry teachers and used as a place to find resources to use during class to help students increase their understanding of geometry.
But Did You Die? Developing Critical Thinking in Paramedics Using Interactive Branching Scenarios
(2021-04-15) Kakazu, Judy; Hoffman, Daniel
The purpose of this project was to design and evaluate scenario-based instruction aimed at improving paramedics' medical assessment skills. Aimed at emergency medical technicians, the project used Keller's ARCS Model, Gagne's Nine Events of Instruction, and the basics of effective game design, to design instruction that presented various medical scenarios within an online platform. The goal of the instruction was to improve the technicians' critical thinking and decision-making skills. To evaluate the instruction, 12 (n = 12) emergency medical technicians participated in an evaluation of the instruction. As participants interacted with the online instruction, data related to the timing and accuracy of their performances were recorded. In addition, open-ended surveys were used to collect qualitative data with regards to the instruction. Results found participants exhibited increased speed and prioritization of questioning per scenario as a result of the instruction. Participants also exhibited increased accuracy in pre-hospital diagnoses and stronger justification of those diagnoses. While participants reported finding the instruction engaging, they indicated that the interactivity of the instruction played a more critical role. This report examines the study's findings in detail and explores possible explanations for training emergency medical technicians. Further study is needed to better understand how problem-based learning using interactive branching scenarios may be beneficial in medical education.
Geospatial Neo-Cartography: Post-Secondary Instruction for Creating a Web-Based Travel Itinerary Map
(2021-05) Erdmann, Lynn; Hoffman, Daniel
Geographical, mapping skills are becoming nonessential with the increasing use of global positioning system (GPS) applications. Consequently, future generations might experience loss of geospatial, cognitive reasoning. Thus, a multifarious, instructional module was designed and evaluated for teaching neo-cartographic creation via the use of a web-based mapping application. Application of Merrill’s “First Principles of Instruction” learning theory allowed students to build upon past and newly gained knowledge. Over 15 days, 39 (n = 39) undergraduates completed a pre-instructional survey that gauged former learning instruction. They next worked an instructional module to assess comprehension of detailed instruction; achievement of geospatial cognitivity; and the experience of creating a digital mashup through neo-cartography instruction. Lastly, they completed a post-instructional survey to share feedback about the module. Ninety-two percent (92%) reported never having used a mapping application to chart travel logistics but would do so in the future. Furthermore, 87% replied that this instruction is necessary with one participant stating that mapping fundamentals should not become obsolete for fear of propagating a geospatially ignorant population. Traditional instruction should not surrender to the conveniences of digital mapping applications. Rather, andragogical instruction must evolve to incorporate contemporary, digital instructional tools.
Where’s My Pineapple? The Usability of a Website for a Hospitality & Tourism Program
(2021-05) Takeda, Julie; Hoffman, Daniel
This paper reports on a usability test conducted to evaluate a website designed to provide a more informative and user-friendly experience to the new students entering the Hospitality and Tourism Program at Kapiʻolani Community College located in Honolulu, Hawaii. The website was designed to be a resource tool for the program’s new student orientation to help students transition into the college and the Hospitality and Tourism Program. The new students (n = 15) were given a URL to the website prior to the new student orientation so they can review the content before attending the orientation if they choose to do so. This also allowed them access to the information at any given time. The website was designed to be evaluated by participants who navigated through the different contents of the webpage by performing several usability tasks. The analysis involved verbal and written feedback obtained by pre and post-surveys concerning the usability, design, and content of the website as well as satisfaction and interest.
Introduction to Google Docs: A Learning Assessment of Online Training for Home-Based Academic Mentors
(Technology, Colleges & Community (TCC), 2021-04-13) Pope, Bryan; Hoffman, Daniel
This project designed and evaluated a web-based training module that leveraged engaging visual graphics and interactive tasks to introduce Google Docs to Home-Based Academic Mentors. Home-Based Academic Mentors are adults who play a significant role in supporting the academic success of a school-aged child outside of the classroom. Such Mentors may include parents, grandparents, extended family members, and close family friends. The purpose of the project was to support Home-Based Academic Mentors’ comprehension and confidence in the ability to apply the concepts of the Google Docs interface. Because daily routines often place a barrier on Mentors’ participation, the learning module was designed to be completed in bite-sized chunks to fit within the Mentors’ busy lives. Data was gathered from twelve (n= 12) members of the target audience using a pre-survey and pre-assessment, a post-instruction culminating activity, and finally a post-survey. Results indicated that the combination of text, narrative, and graphics promoted learner engagement and enhanced comprehension; however, additional scaffolding may be needed in the module’s culminating activity.
Kou Moʻolelo: Your Story, Your Personal Statement
(Technology, Colleges and Community Worldwide Online Conference., 2021-04-13) Carvalho, R. Kalei; Hoffman, Daniel
The purpose of this project was to design and evaluate a web-based workshop created to help first-year college students learn how to write meaningful and organized personal statements for scholarship applications. The project was motivated by the needs of students in The Waiʻaleʻale Project, a First-Year Experience Program at Kauaʻi Community College. These students often believed college was not for them because of various personal challenges. Despite the ability to create compelling personal statements using these challenges, less than 14% of the program’s students received scholarships that required a personal statement during the 2019 – 2020 school year. The researcher designed a web-based workshop to address this problem. The workshop combined Hawaiian culture with storytelling to form connections between students’ personal experiences and essay writing requirements. The instruction was evaluated by having 17 students (n = 17) participate in the workshop. The results indicated that the web-based workshop, grounded in culture, improved participants’ confidence levels to create a personal statement and increased the prospect of submitting higher-quality scholarship applications.
Financial Literacy Relay: A Usability Study
(2021-05-06) Jesse Joseph; Dan Hoffman
Low-income and first-generation students entering college often do not have the same context for understanding financial literacy as students who come from more economically stable backgrounds. Without adequate support or equal access to content, these students often enter college with less financial aid than they could have qualified for. It is important for these students to have the tools needed to understand this information as it directly impacts lives. To address this problem, this project designed and evaluated a financial literacy toolkit. The evaluation examined the toolkit’s impact on participants’ (n = 15) satisfaction, perceived value, and ease of use. The results suggest the resource may assist students in understanding and completing financial aid steps throughout their academic journey.
University of Hawai‘i Maui College Brand and Communications Toolkit: A Usability Study
(2021-05-06) Antosch, Marc; Fulford, Catherine
Consistency in branding and communications plays an integral part in the success of any organization. Branding gives a clear sense of purpose of what an organization does, while external communications help shape the public's perception of who the organization is and what they do. The University of Hawai'i Maui College (UHMC) had a diluted brand due to the absence of a Marketing Director. Having no clear marketing consistency resulted in a weakened UHMC identity and limited community presence. A UHMC brand and communications toolkit (BCT) website will act as a marketing and communications hub for UHMC to support a consistent brand and succinct messaging. This usability study aimed to design and evaluate the BCT website for faculty and staff at UHMC. The usability study assessed the navigation, usability, and effectiveness of the tools and resources contained within the toolkit. Data were collected through quantitative surveys and qualitative walkthroughs.
Design and Evaluation of an Online Food Safety Module: A Usability Study
(2021) Gima, Michelle; Fulford, Catherine
Food safety knowledge is crucial to careers within the restaurant and foodservice industry. High school Career and Technical Education (CTE) elective courses help students explore their career interests and prepare for future employment. Food safety is an important topic relevant to the industry that students can use in their personal lives and future careers. The researcher utilized various visual design and multimedia learning principles to develop an online food safety module on Google Sites targeted toward high school students. The researcher conducted a usability study to evaluate the format, ease of use, and content included in the online food safety module. The researcher collected data from a total of 15 participants via a virtual usability test, including a think-aloud of the website, completion of four task-based scenarios, and an online survey. Data collected during the study and results from the online survey indicated that participants found the website intuitive. The final product can be incorporated into various CTE classes and used as an up-to-date, easily accessible resource.
Making Health Education Palatable: A Usability Study of a Digital Game about Nutrition
(2021-05-06) Yoshimura, Bethany; Hoffman, Daniel
Nutrition is a component of elementary health education that can influence children’s health and well-being. Unfortunately, when educating children about nutrition, many schools face challenges that limit the quality of health instruction. To help address these challenges, a video game called Monster Mealtime was designed to supplement fourth grade health instruction. The game was intended to teach fourth graders about nutrients’ role in maintaining the human body. After the game was developed, it was evaluated through three rounds of usability testing. Twelve adults (n = 12) with elementary teaching experience played the game to assess its ability to support students’ learning of the game and its core concepts while providing a satisfying play experience. After each round, revisions for the game were made to enhance its design. Data were collected through a questionnaire, a usability protocol, and a post-survey. By the end of round three, the game was perceived as satisfying. However, problems persisted with the game’s learnability. While learnability issues related to the game’s visual design were corrected, misconceptions about the game’s mechanics remained prevalent throughout the evaluation period. To enhance the quality of future educational video games, strategies for communicating game instructions clearly must be explored further.
Parents, Guardians and the 4C's
(2021-05-05) Anderson, Maeva Charlotte; Hoffman, Daniel
The purpose of this learning assessment was to evaluate how a web-based learning assessment impacts parents' and guardians' interests and confidence to help their 8th-graders learn the 4Cs of 21st Century learning skills. The shortage of certified Career and Technical Education (CTE) teachers in Hawaii impacts middle school students’ learning and acquisition of 21st Century skills. These skills were exceedingly necessary to enter the workforce or further higher education. For this project, parents and guardians accessed a website to learn about the 4Cs. At the end of their learning, the parents and guardians will be able collect evidence of their child’s 4Cs artifacts and post them into an e-portfolio. At the end of each module from the learning, the participants rated how the module increases their interest and confidence in helping their child learn the 4Cs.
How Do Silicon Valley Tech Companies Do It?
(2021-05-06) Pulu, Byron; Hoffman, Daniel
Silicon Valley companies advertise innovative technologies as solutions to complex problems such as workplace sexual harassment training. Research has shown that amongst healthcare professionals and educators, the use of scenario-based activities in workplace sexual harassment e-learning leads to increased awareness and training effectiveness. However, little is known about the impact of workplace sexual harassment e-learning within Silicon Valley technology companies. Therefore, this project aimed to design and evaluate how scenario-based e-learning about workplace sexual harassment impacts Silicon Valley technology companies. Based on a review of literature, an e-learning course was designed and distributed to managers working for Silicon Valley technology companies to measure changes in the cognitive and affective domains of learning. Analysis of the responses from 28 managers (n=28) demonstrated that increased awareness of workplace sexual harassment and confidence in one’s abilities to address it is positively associated with the use of scenario-based activities. More specifically, their ability to identify and react to behaviors of sexual harassment, and their confidence in creating a safe work environment all increased after participating in the e-learning course. Recommendations for future research include evaluating the e-learning course with a larger sample size and measuring the long-term impact of using scenario-based activities when implementing training on workplace sexual harassment.

Browse

Recent Submissions