Walkthrough Method Research Articles

Problem analysis in nurses' daily use of 3-Minute Diagnostic Interview for CAM-Defined Delirium

Objective To identify and analyze the problems existing in nurses' daily use of 3-Minute Diagnostic Interview for CAM-Defined Delirium (3D-CAM) and to provide a basis for intelligent development of 3D-CAM. Methods From May to June 2018, totally 17 nurses who used printed 3D-CAM for daily evaluation of delirium in the Department of Orthopedics with a high incidence of delirium in a Class Ⅲ Grade A hospital in Beijing were selected by convenient sampling. Researchers observed and recorded the problems in nurses' daily use of 3D-CAM by task-centered walkthrough method till no new problems were found, i.e., the data were saturated and the data collection was completed. Results The 17 orthopedic nurses used printed 3D-CAM for 107 evaluations of 57 patients. According to the walk-through research, it was found that the main causes of misuse of 3D-CAM were man-made errors (n=30) , misunderstanding of items (n=7) , insufficient understanding of items (n=30) , and incomplete/missing nursing records (n=6) . Conclusions Nurses' use of printed 3D-CAM for delirium evaluation showed a high error rate and poor availability. Therefore, we need to enhance the training of delirium evaluation for nurses, conduct intelligent design and development of 3D-CAM and other delirium evaluation tools, and integrate them into the information system of hospitals so as to achieve the informatization, normalization and standardization of delirium evaluation. Key words: Nurses; Delirium; Evaluation; Problem analysis; Intelligent

Digital narrative conventions in heritage trail mobile apps

ABSTRACTGalleries, libraries, archives and museums (GLAMs) are increasingly using digital technologies for storytelling and creating mobile applications (apps) for cultural heritage content, but how apps are used in practice to communicate information to users has not been widely studied. A team of people from a heritage organisation, a university, and mobile app development group plan to create a bespoke heritage trail app for Ireland, but to date design conventions/recommendations for this genre are lacking. This article applies a systematic approach to digital narrative content analysis to better understand how apps are being used specifically for heritage trails with the aim of identifying what the common features are, which modalities and narrative techniques are used. The selected corpus included 55 apps downloaded from the Google Play Store. The results of this content analysis—based on the App Walkthrough Method (Light, B., Burgess, J., & Duguay, S. (2018). The walkthrough method: An approach to the study of apps. New Media & Society, 20(3), 881–900)—show that there is a gap between academic research themes/trends and how digital narrative is actually being communicated in the current market, and it aims to inform the future development of heritage trail apps by including a list of design and content features common to this genre.

Employing a user-centered cognitive walkthrough to evaluate a mHealth diabetes self-management application: A case study and beginning method validation.

Self-management of chronic diseases using mobile health (mHealth) systems and applications is becoming common. Current evaluation methods such as formal usability testing can be very costly and time-consuming; others may be more efficient but lack a user focus. We propose an enhanced cognitive walkthrough (CW) method, the user-centered CW (UC-CW), to address identified deficiencies in the original technique and perform a beginning validation with think aloud protocol (TA) to assess its effectiveness, efficiency and user acceptance in a case study with diabetes patient users on a mHealth self-management application. A total of 12 diabetes patients at University of Utah Health, USA, were divided into UC-CW and think aloud (TA) groups. The UC-CW method included: making the user the main evaluator for detecting usability problems, having a dual domain facilitator, and using three other improved processes: validated task development, higher level tasks and a streamlined evaluation process. Users interacted with the same mHealth application for both methods. Post-evaluation assessments included the NASA RTLX instrument and a set of brief interview questions. Participants had similar demographic characteristics. A total of 26 usability problems were identified with the UC-CW and 20 with TA. Both methods produced similar ratings: severity across all views (UC-CW = 2.7 and TA = 2.6), numbers of problems in the same views (Main View [UC-CW = 11, TA = 10], Carbohydrate Entry View [UC-CW = 4, TA = 3] and List View [UC-CW = 3, TA = 3]) with similar heuristic violations (Match Between the System and Real World [UC-CW = 19, TA = 16], Consistency and Standards [UC-CW = 17, TA = 15], and Recognition Rather than Recall [UC-CW = 13, TA = 10]). Both methods converged on eight usability problems, but the UC-CW group detected five critical issues while the TA group identified two. The UC-CW group identified needed personalized features for patients' disease needs not identified with TA. UC-CW was more efficient on average time per identified usability problem and on the total evaluation process with patients. NASA RTLX scores indicated that participants experienced the UC-CW half as cognitively demanding. Common themes from interviews indicated the UC-CW as enjoyable and easy to perform while TA was considered somewhat awkward and more cognitively challenging. UC-CW was effective for finding severe, recurring usability problems and it highlighted the need for personalized user features. The method was also efficient and had high user acceptance. These results indicate UC-CW's utility and user acceptance in evaluating a mHealth self-management application. It provides an additional usability evaluation technique for researchers.

Implementation and Assessment of an Intelligent Motor Tele-Rehabilitation Platform

Over the past few years, software applications for medical assistance, including tele-rehabilitation, have known an increasing presence in the health arena. Despite the several therapeutic and economic advantages of this new paradigm, it is important to follow certain guidelines, in order to build a safe, useful, scalable, and ergonomic tool. This work proposes to address all these points, through the case study of a physical tele-rehabilitation platform for patients after hip replacement surgery. The scalability and versatility of the system is handled by the implementation of a modular architecture. The safeness and effectiveness of the tool is ensured by an artificial intelligence module that assesses the quality of the movements performed by the user. The usability of the application is evaluated by a cognitive walkthrough method. Results show that the system (i) is able to properly assess the correctness of the human’s motion through two possible methods (Dynamic Time Warping and Hidden Markov Model), and (ii) provides a good user experience. The discussion addresses (i) the advantages and disadvantages of the main approaches for a gesture recognition of therapeutic movements, and (ii) critical aspects to provide the patient with the best usability of a tele-rehabilitation platform.

Evaluation of APi Interface Design by Applying Cognitive Walkthrough

The usability evaluation of APi interface design was conducted through Cognitive Walkthrough method. APi is a mobile application game designed specifically for preschool children of Tabika Kemas Kampung Berawan, Limbang Sarawak in order to learn about fire safety education. The existing fire safety games have few interaction styles issues and interface design tested on preschool children. A key ingredient to promote the preschool children to learn basic skills of fire safety is by providing them an interactive learning as the new learning method. Low-fidelity of APi prototype was designed based on the user requirements of the preschool children focusing on cognitive, psychomotor and behaviour aspects. This Cognitive Walkthrough method applied on APi interface design involved a small group of professional designers and developers. As a result, the high-fidelity of APi prototype interface design was developed for the preschool children.

A Heuristic Method to Evaluate Web Accessibility for Users With Low Vision

Checking the accessibility of a website is a significant challenge for accessibility experts. Users who suffer from age-related changes, such as low vision, poor hearing, and diminishing motor skills, among others, have problems accessing the services offered by the web. Currently, there are qualitative and quantitative methods to check if a website is accessible. Most methods apply automatic tools because they are low cost, but they do not present an ideal solution. Instead, heuristic methods require manual support that will help the expert to assess accessibility by establishing severity ranges. This research used a modification of the Barrier Walkthrough method proposed by Giorgio Brajnik considering the Web Content Accessibility Guidelines 2.1. The modification consisted of including persistence to determine the severity of an accessibility barrier. This method enabled the measurement of the accessibility of websites to test a new heuristic process and to obtain sample data for analysis. The method was applied to 40 websites, including those of 30 universities in Latin America, according to the Webometrics ranking, and 10 websites among the most visited, according to Alexa ranking. With this heuristic method, the evaluators concluded that although a website is in a high-ranking position, this does not imply that it is accessible and inclusive. However, the manual method takes too long, and it is therefore too costly to solve accessibility problems. This research can serve as a starting point for future studies related to web accessibility heuristics.

Application of the Cognitive Walkthrough Method to Evaluate the Usability of PhET Simulations Package to Teach Physics

The use of simulators and customized applications for educational use opens new possibilities in the teaching and learning process of the most varied disciplines through computer-mediated interactions. In this context, teachers are developing digital material considering this powerful tool. And the use of educational apps and simulators has increased significantly with the spread of the internet in schools. However, the evaluation of the effectiveness of these applications is complex and incipient. This article presents a proposed interface usability assessment for the use of simulators with elementary school students using a customized version of the PSSUQ, along with an evaluation by the cognitive walkthrough method. The interface chosen was the simple pendulum simulator used as part of the PhET simulations package. The results indicated satisfactory usability of the application, although some limitations and usability difficulties were found.

“Warning! You’re entering a sick zone”

PurposeTraditional public health methods for tracking contagious diseases are increasingly complemented with digital tools, which use data mining, analytics and crowdsourcing to predict disease outbreaks. In recent years, alongside these public health tools, commercial mobile apps such as Sickweather have also been released. Sickweather collects information from across the web, as well as self-reports from users, so that people can see who is sick in their neighborhood. The purpose of this paper is to examine the privacy and surveillance implications of digital disease tracking tools.Design/methodology/approachThe author performed a content and platform analysis of two apps, Sickweather and HealthMap, by using them for three months, taking regular screenshots and keeping a detailed user journal. This analysis was guided by the walkthrough method and a cultural-historical activity theory framework, taking note of imagery and other content, but also the app functionalities, including characteristics of membership, “rules” and parameters of community mobilization and engagement, monetization and moderation. This allowed me to study HealthMap and Sickweather as modes of governance that allow for (and depend upon) certain actions and particular activity systems.FindingsDraw on concepts of network power, the surveillance assemblage, and Deleuze’s control societies, as well as the data gathered from the content and platform analysis, the author argues that disease tracking apps construct disease threat as omnipresent and urgent, compelling users to submit personal information – including sensitive health data – with little oversight or regulation.Originality/valueDisease tracking mobile apps are growing in popularity yet have received little attention, particularly regarding privacy concerns or the construction of disease risk.

Queer women’s experiences of patchwork platform governance on Tinder, Instagram, and Vine

Leaked documents, press coverage, and user protests have increasingly drawn attention to social media platforms’ seemingly contradictory governance practices. We investigate the governance approaches of Tinder, Instagram, and Vine through detailed analyses of each platform, using the ‘walkthrough method’ (Light, Burgess, and Duguay, 2016 The walkthrough method: An approach to the study of apps. New Media & Society 20(3).), as well as interviews with their queer female users. Across these three platforms, we identify a common approach we call ‘patchwork platform governance’: one that relies on formal policies and content moderation mechanisms but pays little attention to dominant platform technocultures (including both developer cultures and cultures of use) and their sustaining architectures. Our analysis of these platforms and reported user experiences shows that formal governance measures like Terms of Service and flagging mechanisms did not protect users from harassment, discrimination, and censorship. Key components of the platforms’ architectures, including cross-platform connectivity, hashtag filtering, and algorithmic recommendation systems, reinforced these technocultures. This significantly limited queer women’s ability to participate and be visible on these platforms, as they often self-censored to avoid harassment, reduced the scope of their activities, or left the platform altogether. Based on these findings, we argue that there is a need for platforms to take more systematic approaches to governance that comprehensively consider the role of a platform’s architecture in shaping and sustaining dominant technocultures.

Usability evaluation of obstetrics and gynecology information system using cognitive walkthrough method.

Background and aimObstetrics and gynecology information system is a critical component of the HIS in social security organization health centers. The objective of this study was to evaluate the usability of this system using the cognitive walkthrough method. Also, the present study provided a detailed formal description of how the cognitive usability evaluation can be applied and reported for a health care information system.MethodsThis study was conducted at the Mashhad University of Medical Sciences’ usability lab from March 2016 to June 2017. A two-phase approach was used to conduct the cognitive walkthrough evaluation: preparatory and evaluation. The preparation was done in three stages: first, we investigated users’ capabilities and background knowledge through a semi-structured interview. Second, the evaluation scenario was developed based on the most common tasks in routine workflow of users. Finally, each task was broken down into sequences of actions. In the evaluation phase, three usability experts independently assessed each action using a four-item checklist. Problems were categorized thematically and were reported from three different perspectives: Question-based, Task-based, and Evaluator-based. The data were then analyzed to understand the contribution of each task, along with its mean severity score.ResultsEvaluators’ responses were compared and any conflict was resolved in an expert panel. A total of 116 usability problems were identified based on the consensus of the evaluators. Inadequate system feedback was found to be the main source of 43% of the problems, and resulted in users confusion.ConclusionSince the system was evaluated in its pilot implementation phase, there was an opportunity to prevent future potential usability problems. The use of a mixed quantitative and qualitative approach in this usability study provided a more comprehensive perspective of the system problems. This study provided a detailed description of conducting CW usability evaluation which can be used as a practical guide for future studies.

Virtual Reality for Prototyping Service Journeys

The use of virtual elements for developing new service prototyping environments and more realistic simulations has been suggested as a way to optimise the service prototyping process. This work examines the application of virtual reality (VR) in prototyping service journeys and it hypothesises that VR can recreate service journeys in a highly immersive, agile, and inexpensive manner, thus allowing users to have a representative service experience and enabling service designers to extract high-quality user feedback. To that end, a new service prototyping method, called VR service walkthrough, is presented and evaluated through an empirical comparative study. A VR service walkthrough is a virtual simulation of a service journey, representing how the service unfolds over space and time. A comparative study between the VR service walkthrough method and an adapted service walkthrough method evaluates the application of both methods using a location-based audio tour guide service as a case study. Two user groups (each with 21 users) were used to evaluate both methods based on two factors: the user experience they offered and the subjective meaningfulness and quality of feedback they produced. Results show that the VR service walkthrough method gave a performance similar to that of the service walkthrough method. It was also able to communicate the service concept in an immersive way and foster constructive feedback.

Usability Evaluation Using Multi-Method for Improvement Interaction in M-Commerce

Today, M-Commerce has become one of the common choices as a way of shopping for society. Therefore, the transaction in m-commerce grows significantly. Moreover, the competition of M-Commerce increases and the performance should be improved primarily for the satisfaction of buyers. These conditions are seen from an improvement of the features and service options that can be used by users, even outside the process of buying and selling goods. Increasing amount of features may reduce the usability of the application which may impact on the performance of M-Commerce. Therefore, this study aims to evaluate the usability of M-Commerce service. Our study addressed to evaluate the usability of one famous M-Commerce in Indonesia. The evaluation process was performed by using cognitive walkthrough and heuristic usability method. Data collection is done by using depth interview and questionnaire to collect quantitative and qualitative data. Our findings show some new insight for designers and developers about M-Commerce especially about usability and the potential of usability to improving the satisfaction of users in terms of using the M-Commerce application overall.

Social media’s breaking news: the logic of automation in Facebook Trending Topics and Twitter Moments

This article draws on van Dijck and Poell’s framework of social media logic to examine two platform news functionalities: Facebook Trending Topics and Twitter Moments. It uses the walkthrough method to investigate their technical features while also examining how they fit into platforms’ economic interests and regulatory processes. While the framework of social media logic enables the identification of platforms’ influential elements – programmability, popularity, connectivity and datafication – embedded in news functionalities, a fifth element becomes apparent. The logic of automation naturalises these elements into processes of news distribution through claims that platform news functionalities are free from human intervention. By perpetuating the logic of automation, platforms position themselves as neutral conduits of news information. Expanding the framework of social media logic to include automation enables future analysis of platform developers’ evasion of accountability for shaping social and institutional processes, supported through their claims to produce unbiased automated technologies.

Evaluation of NextGen Air Traffic Control Alarms and Alerts Using Cognitive Walkthrough Method

In the air traffic control domain, there are no clear distinctions in the definition of critical safety messages, such as alarms and alerts. We therefore created a categorization scheme to distinguish alarms from the alerts and applied it to NextGen air traffic control systems: Standard Terminal Automation Replacement System (STARS), En Route Automation Modernization (ERAM), and Data Communications. Controllers then evaluated the effectiveness of the alarms and alerts of these NextGen systems. We used Cognitive Walkthrough method with the “thinking aloud” procedure to collect their spontaneous and immediate evaluation. Based on these evaluations, we present recommendations for the future NextGen air traffic control alarm and alert design.

The walkthrough method: An approach to the study of apps

Software applications (apps) are now prevalent in the digital media environment. They are the site of significant sociocultural and economic transformations across many domains, from health and relationships to entertainment and everyday finance. As relatively closed technical systems, apps pose new methodological challenges for sociocultural digital media research. This article describes a method, grounded in a combination of science and technology studies with cultural studies, through which researchers can perform a critical analysis of a given app. The method involves establishing an app’s environment of expected use by identifying and describing its vision, operating model and modes of governance. It then deploys a walkthrough technique to systematically and forensically step through the various stages of app registration and entry, everyday use and discontinuation of use. The walkthrough method establishes a foundational corpus of data upon which can be built a more detailed analysis of an app’s intended purpose, embedded cultural meanings and implied ideal users and uses. The walkthrough also serves as a foundation for further user-centred research that can identify how users resist these arrangements and appropriate app technology for their own purposes.

A culturally tailored Internet cancer support group for Asian American breast cancer survivors: A randomized controlled pilot intervention study

Introduction The necessity of culturally competent Internet Cancer Support Groups (ICSGs) for ethnic minorities has recently been highlighted in order to increase its attractiveness and usage. The purpose of this study was to determine the preliminary efficacy of a culturally tailored registered-nurse-moderated ICSG for Asian American breast cancer survivors in enhancing the women’s breast cancer survivorship experience. Methods The study included two phases: (a) a usability test and an expert review; and (b) a randomized controlled pilot intervention study. The usability test was conducted among five Asian American breast cancer survivors using a one-month online forum, and the expert review was conducted among five experts using the Cognitive Walkthrough method. The randomized controlled pilot intervention study (a pre-test and post-test design) was conducted among 65 Asian American breast cancer survivors. The data were analysed using content analysis and descriptive and inferential statistics including the repeated ANOVA. Results All users and experts positively evaluated the program and provided their suggestions for the display, educational contents, and user-friendly structure. There were significant positive changes in the support care needs and physical and psychological symptoms (p < 0.05) of the control group. There were significant negative changes in the uncertainty level of the intervention group (p < 0.10). Controlling for background and disease factors, the intervention group showed significantly greater improvements than the control group in physical and psychological symptoms and quality of life (p < 0.10). Discussion The findings supported the positive effects of ICSGs on support care needs, psychological and physical symptoms, and quality of life.

The rise of speculative devices: Hooking up with the bots of Ashley Madison

I attend to two areas of increasing significance in relation to Web 2.0 since its announcement in 2005. The first is a focus on the non-human in digital media research, and the second is the normalisation of dating apps in society. Building upon ideas from speculative design and speculative method, I introduce the idea of speculative devices, those things that are set in place based on a conjecture of an outcome. Drawing upon a case study of Ashley Madison, generated using a walkthrough method and analysis of media coverage, I demonstrate how the speculative devices of bots and profiles can operate, and why. I argue we need to give careful thought to how our research and practice is understood, and conducted where speculative devices are concerned.

Lesbian, Gay, Bisexual, Trans, and Queer Visibility Through Selfies: Comparing Platform Mediators Across Ruby Rose’s Instagram and Vine Presence

This article investigates the relationship between social media platforms and the production and dissemination of selfies in light of its implications for the visibility of lesbian, gay, bisexual, trans, and queer (LGBTQ) people. Applying an Actor Network Theory lens, two popular visual media apps, Instagram and Vine, are examined through a comparative walkthrough method. This reveals platform elements, or mediators, that can influence the conversational capacity of selfies in terms of the following: range, the variety of discourses addressed within a selfie; reach, circulation within and across publics; and salience, the strength and clarity of discourses communicated through a selfie. These mediators are illustrated through LGBTQ celebrity Ruby Rose’s Instagram selfies and Vine videos. Instagram’s use expectations encourage selfies focused on mainstream discourses of normative beauty and conspicuous consumption with an emphasis on appearance, extending through features constraining selfies’ reach and salience. In contrast, Vine’s broader use expectations enable a variety of discourses to be communicated across publics with an emphasis on creative, first-person sharing. These findings are reflected in Rose’s Instagram selfies, which mute alternative discourses of gender and sexuality through desexualized and aesthetically appealing self-representations, while Vines display her personal side, enabling both LGBTQ and heterosexual, cisgender people to identify with her without minimizing non-normative aspects of her gender and sexuality. These findings demonstrate the relevance of platforms in shaping selfies’ conversational capacity, as mediators can influence whether selfies feature in conversations reinforcing dominant discourses or in counterpublic conversations, contributing to everyday activism that challenges normative gender and sexual discourses.

Dressing up Tinderella: interrogating authenticity claims on the mobile dating app Tinder

ABSTRACTMobile dating applications (‘apps’) have increased in popularity over recent years, with Tinder among the first to break into the mainstream heterosexual market. Since mobile dating intensifies the need to confirm that potential dates are not misrepresenting themselves and are safe to meet in person, Tinder’s success indicates that it has allayed these concerns regarding the authenticity of its users. This article combines Giddens’ conceptualization of authenticity, as the ability to reference a coherent biographical narrative, with Callon’s sociology of translation to investigate Tinder’s framing of authenticity within mobile dating. Applying a walkthrough method that interrogates Tinder’s technological architecture, promotional materials, and related media, this hybrid theoretical framework is used to identify how Tinder configures an actor-network that establishes its app as the solution to users’ concerns, enrols individuals in using its features in authenticity claims, and popularizes Tinder’s framing across public discourse. This network of human and non-human actors frames authenticity as being established through one’s Facebook profile and adherence to normative standards relating to age, gender, ethnicity, and socio-economic status. However, user discourses on other social media identify and challenge negative outcomes of this framing, with normativity fostering discrimination and Facebook verification failing to prevent abusive behaviour. This case study of Tinder paves the way for future investigation into user responses to its framing. Furthermore, it demonstrates the efficacy and broader applicability of this theoretical approach for identifying both human and technological influences on the construction of authenticity with digital media.

A Qualitative Analysis of NWS Forecasters’ Use of Phased-Array Radar Data during Severe Hail and Wind Events

Abstract The 2013 Phased Array Radar Innovative Sensing Experiment (PARISE) investigated the impacts of higher-temporal-resolution radar data on National Weather Service forecasters’ warning decision processes during severe hail and wind events. In total, 12 forecasters participated in the 2013 PARISE over a 6-week period during the summer of 2013. Participants were assigned to either a control [5-min phased-array radar (PAR) updates] or experimental (1-min PAR updates) group, and worked two cases in simulated real time. This paper focuses on the qualitative retrospective reports of participants’ warning decision processes that were collected using the recent case walk-through method. Timelines of participants’ warning decision process were created for both cases, which were then thematically coded according to a situational awareness framework. Coded themes included perception, comprehension, and projection. It was found that the experimental group perceived significantly more information during both cases than the control group (case 1 p = 0.045 and case 2 p = 0.041), which may have improved the quality of their comprehensions and projections. Analysis of timelines reveals that 1-min PAR updates were important to the experimental group’s more timely and accurate warning decisions. Not only did the 1-min PAR updates enable experimental participants to perceive precursor signatures earlier than control participants, but through monitoring trends in radar data, the experimental group was able to better detect storm motion, more accurately identify expected weather threats from severe thunderstorms, more easily observe strengthening and diminishing trends in storms, and make more correct tornado-related warning decisions.