Visual App Research Articles

A Mobile Augmented Reality App for Creating, Controlling, Recommending Automations in Smart Homes

Automations in the context of smart homes have been adopted more and more frequently; thus, users should be able to control them and create automations most suitable to their needs. Current solutions for this purpose are based on visual apps with conceptual representations of possible automation elements. However, they tend to be static, abstract, and detached from the user's real context. In this paper, we propose a novel solution based on mobile augmented reality, which provides situated, dynamic representations associated with the physical objects available in the current users' context while they are freely moving about. It allows direct interaction with the objects of interest, monitoring nearby objects' automations while moving, and creating new automations or modifying existing ones. It also supports users with recommendations of object and service configurations relevant to complete the editing of the new automations. The paper also reports on a user test, which provided positive feedback.

Mixed-methods study of development and design needs for CommitFit, an adolescent mHealth App.

Adolescent obesity remains a significant public health issue within the United States. Mobile application technology growth and popularity offer new opportunities for research and health improvement. The development of a consolidated mobile health application (mHealth app) for adolescents on these platforms has the potential to improve health outcomes. Thus, this study describes the co-development process working with adolescent users. The aims are as follows: (I) to explore the visual design and functional requirements when developing the CommitFit mHealth app, (II) to uncover the gamification techniques that incentivize adolescents to set and achieve healthy lifestyle goals, and (III) to identify adolescent expectations when using the CommitFit mHealth application. In this mixed method study, we used semi-structured interviews/task analysis and surveys of adolescents (aged 13 to 15 years) to understand their user requirements and design preferences during the development of the CommitFit mHealth app. Interviews were conducted online, via Zoom. The survey included the user design industry-standard System Usability Scale (SUS) paired with a supplemental questionnaire on the specific features and functionalities of the CommitFit mHealth app. Participants were recruited from the electronic health record from the University of Missouri Healthcare system. Ten adolescents, aged 13 to 15 years (average of 13.6 years), were interviewed and surveyed to explore adolescent preferences with visual app design and functionality. Our inductive thematic analysis found that adolescents preferred colorful, user-friendly interfaces paired with gamification in the CommitFit mHealth app. Our analysis of SUS survey data validated our user-centered and human-system design and adolescents confirmed their design, feature, and functionality preferences. Overall, adolescent users were able to confirm their preference to have educational resources, goal recommendations, leaderboard, points, reminders, and an avatar in the app. Adolescent feedback is crucial in the successful development of our adolescent-targeted mHealth app, CommitFit. Adolescents preferred vibrant colors, easy-to-use interface, gamification, customizable and personalized, and mature graphics. Adolescents were especially motivated by gamification techniques to maintain their interest in the application and their health behavior goals. Additional research is now needed to explore the clinical effectiveness of the CommitFit mHealth app, as a health and lifestyle intervention.

MSMpred: interactive modelling and prediction of individual evolution via multistate models

BackgroundModelling the course of a disease regarding severe events and identifying prognostic factors is of great clinical relevance. Multistate models (MSM) can be used to describe diseases or processes that change over time using different states and the transitions between them. Specifically, they are useful to analyse a disease with an increasing degree of severity, that may precede death. The complexity of these models changes depending on the number of states and transitions taken into account. Due to that, a web tool has been developed making easier to work with those models.ResultsMSMpred is a web tool created with the shiny R package that has two main features: 1) to allow to fit a MSM from specific data; 2) to predict the clinical evolution for a given subject. To fit the model, the data to be analysed must be upload in a prespecified format. Then, the user has to define the states and transitions as well as the covariates (e.g., age or gender) involved in each transition. From this information, the app returns histograms or barplots, as appropriate, to represent the distributions of the selected covariates and boxplots to show the patient’ length of stay (for uncensored data) in each state. To make predictions, the values of selected covariates from a new subject at baseline has to be provided. From these inputs, the app provides some indicators of the subject’s evolution such as the probability of 30-day death or the most likely state at a fixed time. Furthermore, visual representations (e.g., the stacked transition probabilities plot) are given to make predictions more understandable.ConclusionsMSMpred is an intuitive and visual app that eases the work of biostatisticians and facilitates to the medical personnel the interpretation of MSMs.

Development and Design Needs of Mobile Health (mHealth) Apps for Adolescents.

Context: Adolescent obesity remains a significant public health issue within the United States. Application (app) technology growth and popularity offer new opportunities for research and health improvement. The development of a consolidated mobile health application (mHealth app) for adolescents on these platforms has the potential to improve health outcomes. Most mHealth apps for adolescents, particularly those in the commercial arena, are scaled-down from an adult-targeted app and lack relevant stakeholder feedback. Objectives: To identify adolescent expectations when using an mHealth application and understand visual user-interface needs, and to develop an intuitive and engaging user-interface, we aim to describe the design and functional user requirements for mHealth app. We aim to inform future researchers and app developers about adolescent needs and preferences, as identified by adolescent stakeholders. Study Design: In this mixed method study, we used surveys and interviews/task analysis of adolescents to understand their user requirements and design preferences during the development of a healthy lifestyle app (CommitFit). The survey included the user design industry-standard System Usability Scale (SUS) paired with supplemental questionnaire on the specific features and functionalities of the CommitFit mHealth app. Population Studied: Adolescents ranged from the ages of 13 to 15 years of age, with an average age of 13.6 years old. Results: Ten adolescents were interviewed and surveyed (adapted SUS and supplemental questionnaire) to explore adolescent preferences with visual app design and functionality. Our qualitative results showed that adolescents preferred colorful, user-friendly interfaces paired with gamification to use an mHealth app. Our analysis of SUS survey data validated our user-centered and human-system design and adolescents confirmed their design, feature, and functionality preferences. Adolescent users found CommitFit to be easy to use and provided guidance for visual design needs and preferences. Outcomes: Adolescent stakeholder feedback is crucial in the successful development of an adolescent-targeted mHealth app. Adolescents prefer vibrant colors, modern, easy-to-use interface, gamification and rewards, customizable and personalized, simple, and mature graphics. Adolescents were especially motivated by gamification techniques in maintaining their interest in the application and their health behavior goals.

Find, Pin, Discuss: Incorporating Pinterest to Foster Community and Collaboration in Online Advertising Classes

Visual bookmarking app Pinterest, known for its aspirational and consumptive qualities of users' “pinning” work, has recently made concerted forays into the online advertising and marketing space. At the same time, its visual and collaborative qualities offer unique potential for application in pedagogy. This paper describes a pedagogical assessment study examining a Pinterest-based discussion board series. Results suggest Pinterest enhances students’ sense of learning through contributing to enjoyment, sense of community, and perceived collaborative learning. These results support the utility of Pinterest-oriented discussions to foster collaboration and learning in online digital advertising and media courses.

Comparative Effectiveness of Enhanced Patient Instructions for Bowel Preparation Before Colonoscopy: Network Meta-analysis of 23 Randomized Controlled Trials.

BackgroundVarious enhanced patient instructions (EPIs) have been used for bowel preparation (BP) and our previous meta-analysis also demonstrated the efficacy of EPIs in increasing the colonic polyp and adenoma detection rates; however, the optimal method for adequate BP has not yet been developed.ObjectiveWe performed a network meta-analysis to determine the optimal instructions.MethodsWe searched for randomized controlled trials (RCTs) comparing the effectiveness of EPIs with each other or standard patient instructions (SPIs) for BP. We performed direct and Bayesian network meta-analyses for all instructions and used the GRADE (Grading of Recommendations Assessment, Development and Evaluation) criteria to appraise the quality of evidence.ResultsWe included 23 RCTs (7969 patients) comparing 10 different instructions. In direct meta-analyses, most of the EPIs, except visual aids and mobile apps, increased the adequate preparation rate (APR). Network meta-analyses showed that additional explanations were superior to visual aids (odds ratio [OR] 0.35, 95% CI 0.19-0.59), telephone calls (OR 0.62, 95% CI 0.37-0.99), educational videos (OR 0.79, 95% CI 0.5-0.77), and mobile apps (OR 0.33, 95% CI 0.14-0.68) with low-to-high-quality evidence; newly designed booklets (OR 3.28, 95% CI 1.59-6.16), SMS text messaging (OR 2.33, 95% CI 1.28-3.91), telephone calls (OR 1.86, 95% CI 1.03-1.78), educational videos (OR 2.33, 95% CI 1.40-3.65), and social media applications (OR 2.42, 95% CI 1.4-3.93) were superior to visual aids and mobile apps with low-to-high-quality evidence. SMS text messaging, telephone calls, and social media applications increase adherence to and satisfaction with the BP regime. Social media applications reduce the risk of adverse events (AEs). Telephone calls and social media applications increase the polyp detection rate (PDR).ConclusionsNewly designed booklets, telephone calls, educational videos, and social media applications can improve the quality of BP. Telephone calls and social media applications improve adherence to and satisfaction with the BP regime, reduce the risk of AEs, and increase the PDR.Trial RegistrationINPLASY (International Platform of Registered Systematic Review and Meta-analysis Protocols) INPLASY2020120103; https://inplasy.com/inplasy-2020-12-0103/

Deep Neural Network–based Enhancement for Image and Video Streaming Systems: A Survey and Future Directions

Internet-enabled smartphones and ultra-wide displays are transforming a variety of visual apps spanning from on-demand movies and 360° videos to video-conferencing and live streaming. However, robustly delivering visual content under fluctuating networking conditions on devices of diverse capabilities remains an open problem. In recent years, advances in the field of deep learning on tasks such as super-resolution and image enhancement have led to unprecedented performance in generating high-quality images from low-quality ones, a process we refer to as neural enhancement. In this article, we survey state-of-the-art content delivery systems that employ neural enhancement as a key component in achieving both fast response time and high visual quality. We first present the components and architecture of existing content delivery systems, highlighting their challenges and motivating the use of neural enhancement models as a countermeasure. We then cover the deployment challenges of these models and analyze existing systems and their design decisions in efficiently overcoming these technical challenges. Additionally, we underline the key trends and common approaches across systems that target diverse use-cases. Finally, we present promising future directions based on the latest insights from deep learning research to further boost the quality of experience of content delivery systems.

Patient and Provider Cocreation of Mobile Texting Apps to Support Behavioral Health: Usability Study.

BackgroundMobile technologies hold potential for improving the quality of care and engagement of patients. However, there are considerable challenges in ensuring that technologies are relevant, useful, and engaging. While end users such as patients and providers are increasingly involved in the design of health technologies, there are limited examples of their involvement in directly creating technologies for their personal use.ObjectiveWe aim to evaluate the feasibility and acceptability of patients and providers creating mobile texting apps to support treatment goals.MethodsIn an 11-month usability study, we enrolled 4 providers and 28 patients in an intensive outpatient program for obsessive-compulsive disorder. Patients and providers created their own mobile texting apps using a visual app development platform. A subsample of 10 patients and 4 providers completed a usability measure.ResultsParticipants created a total of 360 unique mobile text messages (1787 total messages sent). There were 4 types of messages identified, including personalized reminders, clinical exposures, interactive prompts, and encouraging/informational messages. A total of 9 out of 10 (90%) patients agreed that the messages were relevant to their recovery, and 8 out of 10 (80%) agreed that the messages were effective at helping complete treatment plans.ConclusionsEnabling patients and providers to cocreate apps for their own use by using a visual application platform is feasible and holds potential for increasing the relevance, sustainability, and effectiveness of digital health technologies.

Enhanced Patient Education for Colonic Polyp and Adenoma Detection: Meta-Analysis of Randomized Controlled Trials.

Background To improve patients’ comprehension of bowel preparation instructions before colonoscopy, enhanced patient education (EPE) such as cartoon pictures or other visual aids, phone calls, mobile apps, multimedia education and social media apps have been proposed. However, it is uncertain whether EPE can increase the detection rate of colonic polyps and adenomas.ObjectiveThis meta-analysis aimed to evaluate the efficacy of EPE in detecting colonic polyps and adenomas.MethodsWe searched PubMed, EMBASE, and Cochrane Central Register of Controlled Trials from their inception to June 2019 for the identification of trials comparing the EPE with standard patient education for outpatients undergoing colonoscopy. We used a random effects model to calculate summary estimates of the polyp detection rate (defined as the number of patients with at least one polyp divided by the total number of patients undergoing selective colonoscopy), adenoma detection rate (defined as the number of patients with at least one adenoma divided by the total number of patients undergoing selective colonoscopy), advanced adenoma detection rate (defined as the number of patients with at least one advanced adenoma divided by the total number of patients undergoing selective colonoscopy), sessile serrated adenoma detection rate (defined as the number of patients with at least one sessile serrated adenoma divided by the total number of patients undergoing selective colonoscopy), cancer detection rate (defined as the number of patients with at least one cancer divided by the total number of patients undergoing selective colonoscopy), or adenoma detection rate - plus (defined as the number of additional adenomas found after the first adenoma per colonoscopy). Moreover, we conducted trial sequential analysis (TSA) to determine the robustness of summary estimates of all primary outcomes.ResultsWe included 10 randomized controlled trials enrolling 4560 participants for analysis. The meta-analysis suggested that EPE was associated with an increased polyp detection rate (9 trials; 3781 participants; risk ratio [RR] 1.19, 95% CI 1.05-1.35; P<.05; I2=42%) and adenoma detection rate (5 trials; 2133 participants; RR 1.37, 95% CI 1.15-1.64; P<.001; I2=0%), which were established by TSA. Pooled result from the inverse-variance model illustrated an increase in the sessile serrated adenoma detection rate (3 trials; 1248 participants; odds ratio 1.76, 95% CI 1.22-2.53; P<.05; I2=0%). One trial suggested an increase in the adenoma detection rate - plus (RR 4.39, 95% CI 2.91-6.61; P<.001). Pooled estimates from 3 (1649 participants) and 2 trials (1375 participants) generated no evidence of statistical difference for the advanced adenoma detection rate and cancer detection rate, respectively.ConclusionsThe current evidence indicates that EPE should be recommended to instruct bowel preparation in patients undergoing colonoscopy because it can increase the polyp detection rate, adenoma detection rate, and sessile serrated adenoma detection rate. However, further trials are warranted to determine the efficacy of EPE for advanced adenoma detection rate, adenoma detection rate - plus, and cancer detection rate because of limited data.

P1463Cardiology, cardiovascular clinical and economical beneficiary outcomes of tele-cardiology, e-audio-visual cardiology and m-cardiology: TEAM study at multi cardiac centre in India

Abstract Background Telemedicine has beneficiary aspect to manage health and reduce the burden of illness. It represent health promotion with support of many ways like tele (distance mode), e (electronic mode), audio visual mode and m (mobile or smart phones) mode etc. Objectives To evaluate the cardiovascular land economical outcomes of tele-cardiology, e-cardiology, audio-visual cardiology and m-cardiology in large population and to review with increase awareness and application of telemedicine. Methods We enrolled 12872 patients from different cardiac centres in india and registered in TEAM (Tele-cardiology, E-cardiology, Audio-visual cardiology and M-cardiology) registry from 2008 to 2018. We included tele diagnosis, tele assistance, tele monitoring, tele therapy, electronic remot media, audio visual media and mobile apps for management of different category of cardiovascular disease like coronary heart and structural heart disease, hypertension, heart failure and congenital heart disorders. We compared TEAM registry with usual group (n=13229) at the platform of beneficiary outcomes regarding diagnostic, therapeutic significance, economical burden, mortality and rate of hospitalization. Results Our data revealed that 34% more correction of the diagnosis of congenital heart diseases, 29% reduction of unnecessary transport of acute coronary syndrome and non cardiac chest pain from primary to higher cardiac centre. 38% patients of ST elevation of myocardial infarction were benefited by facilliated angioplasty and 50% mortality risk reduction in TEAM registry as compare usual group. In heart failure patients, 12 months clinical outcomes revealed that there was a significant reduction in rehospitalizations in the TEAM group compared with the usual-care group (19.6% versus 33.7%,) and also found 29% stroke reduction in TEAM group. Usual group showed 2.5 fold higher economical burden than TEAM registry. Conclusion Total approach of telemedicine in cardiology service may diagnose correctly at root level, prevent clinical instability, reduce rehospitalization and lower the cost of managing heart patients.

Evaluation of a visual tool co-developed for training hospital staff on the prevention and control of the spread of healthcare associated infections.

Staff training in infection prevention and control (IPC) across hospital settings has a crucial role in reducing the incidence of healthcare associated infections (HAIs). However the application of dynamic visualisation approaches in this context is under-developed, with very few in-depth evaluation studies of related processes and impacts. A prototype training tablet app for hospital staff, using interactive visuals was developed and evaluated. To demonstrate different pathogen behaviour, dynamic visualisations of norovirus, Clostridium difficile, and MRSA were developed in relation to location, survival and transmission within a virtual hospital ward model using evidence-based microbiological and staff behavioural data. A three-stage evaluation process was designed, involving a mixed sample of UK National Health Service staff (doctors, nurses and domestic staff, n=150). Participants reported improved awareness and understanding of the pathogens responsible for HAI, the types of information relevant for different staff cohorts, those aspects of the visualisations which worked well and those which were prone to cause misunderstandings, and suggestions for further development and improvement. The tool appeared to offer staff a new perspective on pathogens, being able to 'see' them contextualised in the virtual ward, making them seem more real. Results showed the benefits of a detailed co-development process and a more contextualised understanding of the potential for visual apps to be used in IPC training.

Development of a visual app for improving learner's pronunciation with ultrasound and the speech accent archive

Although many language learners desire to improve their pronunciation of a foreign language, there are not many apps to help them do so. Most commercial apps for pronunciation evaluation and training focus on only the acoustic signal. However, few systems give visual movements of native speakers’ lips, tongue, and jaw. In this paper, we describe the ongoing development of and app that is programmed in Swift for iPhone. The app incorporates and links together different kinds of phonetic data for the pronunciation learner—for example, recorded frontal and side videos of a native speaker’s face during pronunciation with an ultrasound movie of the tongue moving in the mouth overlaid. The training text is a paragraph from the Speech Accent Archive. The initial version of this app has two systems. First, listening to English sentences by a native speaker and checking tongue movement with ultrasound. Second, this app has buttons that play from user-chosen words and it also plays in slow motion. The method of the...

A Study of Visual Programming Environment for NPE(Novice Programming Environment)

This paper investigates the three main functions of a typical visual app programming environment for Novice Programming developers, and compares the features. The Scratch is a visual programming environment for education, anyone can create a story easy as possible variously interaction, games, animations and more. App inventor provides precise and professional application development capabilities as compared with scratch. App Inventor in runs independently of the computer platform, and has a feature that must be constantly connected to the server over the internet, while the Inventor app runs. M-Bizmaker is suitable for commercial application development, consists of m-BizBuilder, m-BizEngine, m-BizServer or the like, provides a cross-platform visual programming environment.

The panorama between mobile visual platforms is a sentimental bond

Abstract Technically, mobile images belong to the ‘point-and-shoot’ tradition. In this scheme, mobile visual applications have facilitated changes in both the aesthetic qualities of mobile images and their effortless sharing. This mobile technology has developed hand-in-hand with its many different imaginable uses; for instance, mobile modalities allowing families and friends to communicate enable the formation of strong audio-visual bonds. This type of ‘mobile visual habitus’ is created through various sharing channels and can activate creativity, affection and social networks. Taking into account the intimacy involved in the use of mobile visual apps, this article seeks to shed light on aspects of this everyday affective mobile visual usage. How does mobile technology change our relationships with our own mobile visualities, our strong ties (i.e., bonds with friends and family), and thus our own audio-visual private history construction and those of our loved ones? As this question is overly broad, no exact answer or position can be determined. Nevertheless, through micro-social networking examples, I intend to analyse how usage of mobile visual apps will continue to change, influencing and enlarging possible methods of communication and engagement through and with private mobile images. These overarching practices will definitely continue to have an increasing impact in connection with broader cultural and social changes.