Mobile App Rating Scale Score Research Articles

A Global Collaboration to Develop and Pilot Test a Mobile Application to Improve Cancer Pain Management in Nepal.

IntroductionQuality palliative care, which prioritizes comfort and symptom control, can reduce global suffering from non-communicable diseases, such as cancer. To address this need, the Nepalese Association of Palliative Care (NAPCare) created pain management guidelines (PMG) to support healthcare providers in assessing and treating serious pain. The NAPCare PMG are grounded in World Health Organization best practices but adapted for the cultural and resource context of Nepal. Wider adoption of the NAPCare PMG has been limited due to distribution of the guidelines as paper booklets.MethodsBuilding on a long-standing partnership between clinicians and researchers in the US and Nepal, the NAPCare PMG mobile application (“app”) was collaboratively designed. Healthcare providers in Nepal were recruited to pilot test the app using patient case studies. Then, participants completed a Qualtrics survey to evaluate the app which included the System Usability Scale (SUS) and selected items from the Mobile App Rating Scale (MARS). Descriptive and summary statistics were calculated and compared across institutions and roles. Regression analyses to explore relationships (α = 0.05) between selected demographic variables and SUS and MARS scores were also conducted.ResultsNinety eight healthcare providers (n = 98) pilot tested the NAPCare PMG app. Overall, across institutions and roles, the app received an SUS score of 76.0 (a score > 68 is considered above average) and a MARS score of 4.10 (on a scale of 1 = poor, 5 = excellent). 89.8% (n = 88) “agreed” or “strongly agreed” that the app will help them better manage cancer pain. Age, years of experience, and training in palliative care were significant in predicting SUS scores (p-values, 0.0124, 0.0371, and 0.0189, respectively); institution was significant in predicting MARS scores (p = 0.0030).ConclusionThe NAPCare PMG mobile app was well-received, and participants rated it highly on both the SUS and MARS. Regression analyses suggest end-user variables important to consider in designing and evaluating mobile apps in lower resourced settings. Our app design and pilot testing process illustrate the benefits of cross global collaborations to build research capacity and generate knowledge within the local context.

Mobile Apps for People With Rare Diseases: Review and Quality Assessment Using Mobile App Rating Scale.

BackgroundMobile apps are becoming increasingly popular, with 5.70 million apps available in early 2021. Smartphones can provide portable and convenient access to health apps. Here, we consider apps for people with one of the estimated 7000 rare conditions, which are defined as having an incidence of <1 in 2000. The needs of people with rare conditions are known to be different from those of people with more common conditions. The former may be socially isolated (not knowing anyone else who has the condition) and may not be able to find reliable information about the disorder.ObjectiveThe aim of this review is to search for apps developed specifically for people diagnosed with a rare disease and to assess them for quality using the Mobile App Rating Scale (MARS). We examine features that address 6 identified needs of people with a rare disorder and make recommendations for future developers.MethodsGoogle Play Store (Android) and Apple App Store (iOS) were searched for relevant health-related apps specifically for rare diseases. The search included the names of 10 rare disease groups. App quality was determined using MARS, assessing app engagement, functionality, aesthetics, and information.ResultsWe found 29 relevant apps (from a total of 2272) addressing 14 rare diseases or disease groups. The most common rare conditions addressed were cystic fibrosis (n=6), hemophilia (n=5), and thalassemia (n=5). The most common app features were web-based information and symptom trackers. The mean MARS score was 3.44 (SD 0.84). Lowest scores were for engagement.ConclusionsMost apps provided factual and visual information, providing tools for self-monitoring and resources to help improve interactions during health consultations. App origin and quality varied greatly. Developers are recommended to consider ways to make appropriate apps more easily identifiable to consumers, to always include high-quality information, improve engagement, provide qualitative evaluations of the app, and include consumers and clinicians in the design.

Breast Cancer Physical Activity Mobile Intervention: Early Findings From a User Experience and Acceptability Mixed Methods Study.

BackgroundPhysical activity (PA) is the most well-established lifestyle factor associated with breast cancer (BC) survival. Even women with advanced BC may benefit from moderate PA. However, most BC symptoms and treatment side effects are barriers to PA. Mobile health coaching systems can implement functionalities and features based on behavioral change theories to promote healthier behaviors. However, to increase its acceptability among women with BC, it is essential that these digital persuasive systems are designed considering their contextual characteristics, needs, and preferences.ObjectiveThis study aimed to examine the potential acceptability and feasibility of a mobile-based intervention to promote PA in patients with BC; assess usability and other aspects of the user experience; and identify key considerations and aspects for future improvements, which may help increase and sustain acceptability and engagement.MethodsA mixed methods case series evaluation of usability and acceptability was conducted in this study. The study comprised 3 sessions: initial, home, and final sessions. Two standardized scales were used: the Satisfaction with Life Scale and the International Physical Activity Questionnaire–Short Form. Participants were asked to use the app at home for approximately 2 weeks. App use and PA data were collected from the app and stored on a secure server during this period. In the final session, the participants filled in 2 app evaluation scales and took part in a short individual interview. They also completed the System Usability Scale and the user version of the Mobile App Rating Scale. Participants were provided with a waist pocket, wired in-ear headphones, and a smartphone. They also received printed instructions. A content analysis of the qualitative data collected in the interviews was conducted iteratively, ensuring that no critical information was overlooked.ResultsThe International Physical Activity Questionnaire–Short Form found that all participants (n=4) were moderately active; however, half of them did not reach the recommended levels in the guidelines. System Usability Scale scores were all >70 out of 100 (72.5, 77.5, 95, and 80), whereas the overall user version of the Mobile App Rating Scale scores were 4, 4.3, 4.4, and 3.6 out of 5. The app was perceived to be nice, user-friendly, straightforward, and easy to understand. Recognition of achievements, the possibility of checking activity history, and the rescheduling option were positively highlighted. Technical difficulties with system data collection, particularly with the miscount of steps, could make users feel frustrated. The participants suggested improvements and indicated that the app has the potential to work well for survivors of BC.ConclusionsEarly results presented in this study point to the potential of this tool concept to provide a friendly and satisfying coaching experience to users, which may help improve PA adherence in survivors of BC.

Systematic Review of Pelvic Anatomy iOS and Android Applications for Obstetricians and Gynecologists

Resources for learning and enhancing knowledge in medicine, such as mobile applications (apps), have dramatically increased in recent years; however, there is lack of a valid source for identifying the best and most reliable mobile apps. The goal of this study was to identify the highest scoring available pelvic anatomy apps based on quality, content, and functionality for obstetrician-gynecologists using a validated tool. This was a systematic evaluation of anatomy apps in the Apple iTunes (iOS) and Google Play (Android) stores. Exclusions included apps that had nonhuman, nonanatomy content, did not include female pelvic anatomy or were deemed inappropriate for postgraduate level. The validated Mobile App Rating Scale (MARS), a mobile-health (mHealth) app scoring system was used to evaluate apps based on both objective and subjective quality. The authors' MARS scores for each variable were compiled, and the objective, subjective, and overall scores were calculated. The search criteria yielded 2,432 apps: 952 (39%) Apple iTunes store and 1,480 (60.8%) Google Play Store apps. After applying the exclusion criteria, 35 (14 iOS, 8 Android, and 13 iOS/Android) apps were included for evaluation using the MARS system. "Complete Anatomy" app, available for both iOS and Android systems, obtained the highest objective, subjective, and overall MARS score. Although there are numerous anatomy apps available, only a few meet prespecified criteria for functionality, content, quality, and are appropriate for obstetrician-gynecologists. Using a validated scoring system, we present a scored list of female pelvic anatomy apps most appropriate for obstetrician-gynecologists.

Evaluation of mobile health applications for cervical cancer in the digital marketplace.

ObjectiveTo assess the quality of mobile health (mHealth) applications (apps) for cervical cancer using the mobile app rating scale (MARS), APPLICATIONS scoring system, and app rating using specific statements.MethodsWe searched for cervical cancer apps on two major mobile operating systems (Google Play Store and Apple iTunes Store) in March 2021. Eligible apps were downloaded and assessed for quality by two independent reviewers using multimodal assessment tools.ResultsThe overall quality of the MARS score was 2.61±0.795. The highest scoring app was “The American Society for Colposcopy and Cervical Pathology (ASCCP) Management Guidelines” (3.98). Overall, apps scored highest in the functionality domain, followed by information, engagement, and aesthetics domains. The mean±standard deviation of the APPLICATIONS scoring system was 8.50±1.712. The highest-rated apps were “ASCCP Management Guidelines,” “The British Society for Colposcopy and Cervical Pathology (BSCCP),” and “Cervical Cancer Guide.” Apps scored the highest in the paid subscription and price domains. By contrast, apps scored poorly in the text search, literature, and subjective presentation domains. Concerning app content, many apps infrequently provided misconceptions regarding cervical cancer. The apps’ rating using specific statements was 7.81±4.562.ConclusionOverall, the apps analyzed using the MARS and APPLICATIONS scoring systems demonstrated above-average quality. However, there is a need to improve the essential information conveyed by these applications. Moreover, the assessment tools have influenced different app quality rating results, confirming the lack of standardized quality assessment tools for mHealth apps.

Classification of Smoking Cessation Apps: Quality Review and Content Analysis.

BackgroundMany people use apps for smoking cessation, and the effectiveness of these apps has been proven in several studies. However, no study has classified these apps and only few studies have analyzed the characteristics of these apps that influence their quality.ObjectiveThe purpose of this study was to analyze the content and the quality of smoking cessation apps by type and identify the characteristics that affect their overall quality.MethodsTwo app marketplaces (App Store and Google Play) were searched in January 2018, and the search was completed by May 2020. The search terms used were “stop smoking,” “quit smoking,” and “smoking cessation.” The apps were categorized into 3 types (combined, multifunctional, and informational). The tailored guideline of Clinical Practice Guideline for Treating Tobacco Use and Dependence was utilized for evaluating app content (or functions), and the Mobile App Rating Scale (MARS) was used to evaluate the quality. Chi-square test was performed for the general characteristics, and one-way analysis of variance was performed for MARS analysis. To identify the general features of the apps that could be associated with the MARS and content scores, multiple regression analysis was done. All analyses were performed using SAS software (ver. 9.3).ResultsAmong 1543 apps, 104 apps met the selection criteria of this study. These 104 apps were categorized as combined type (n=44), functional type (n=31), or informational type (n=29). A large amount of content specified in the guideline was included in the apps, most notably in the combined type, followed by the multifunctional and informational type; the MARS scores followed the same order (3.64, 3.26, and 3.0, respectively). Regression analysis showed that the sector in which the developer was situated and the feedback channel with the developer had a significant impact on both the content and MARS scores. In addition, problematic apps such as those made by unknown developers or copied and single-function apps were shown to have a large market share.ConclusionsThis study is the first to evaluate the content and quality of smoking cessation apps by classification. The combined type had higher-quality content and functionality than other app types. The app developer type and feedback channel with the app developer had a significant impact on the overall quality of the apps. In addition, problematic apps and single-function apps were shown to have a large market share. Our results will contribute to the use and development of better smoking cessation apps after considering the problems identified in this study.

Mobile Apps for Hematological Conditions: Review and Content Analysis Using the Mobile App Rating Scale.

BackgroundHematological conditions are prevalent disorders that are associated with significant comorbidities and have a major impact on patient care. Concerning new tools for the care of these patients, the number of health apps aimed at hematological patients is growing. Currently, there are no quality analyses or classifications of apps for patients diagnosed with hematological conditions.ObjectiveThe aim of this study is to analyze the characteristics and quality of apps designed for patients diagnosed with hematological conditions by using the Mobile App Rating Scale (MARS).MethodsWe performed an observational, cross-sectional descriptive study of all smartphone apps for patients diagnosed with hematological conditions. A search was conducted in March 2021 using the following terms: anemia, blood cancer, blood disorder, hematological cancer, hematological malignancy, hematological tumor, hematology, hemophilia, hemorrhage, lymphoma, leukemia, multiple myeloma, thalassemia, thrombocytopenia, and thrombosis. The apps identified were downloaded and evaluated by 2 independent researchers. General characteristics were registered, and quality was analyzed using MARS scores. Interrater reliability was measured by using the Cohen κ coefficient.ResultsWe identified 2100 apps in the initial search, and 4.19% (88/2100) of apps met the inclusion criteria and were analyzed. Of the 88 apps, 61% (54/88) were available on Android, 30% (26/88) were available on iOS, and 9% (8/88) were available on both platforms. Moreover, 7% (6/88) required payment, and 49% (43/88) were updated in the last year. Only 26% (23/88) of the apps were developed with the participation of health professionals. Most apps were informative (60/88, 68%), followed by preventive (23/88, 26%) and diagnostic (5/88, 6%). Most of the apps were intended for patients with anemia (23/88, 26%). The mean MARS score for the overall quality of the 88 apps was 3.03 (SD 1.14), ranging from 1.19 (lowest-rated app) to 4.86 (highest-rated app). Only 47% (41/88) of the apps obtained a MARS score of over 3 points (acceptable quality). Functionality was the best-rated section, followed by aesthetics, engagement, information, and app subjective quality. The five apps with the highest MARS score were the following: Multiple Myeloma Manager, Hodgkin Lymphoma Manager, Focus On Lymphoma, ALL Manager, and CLL Manager. The analysis by operating system, developer, and cost revealed statistically significant differences in MARS scores (P<.001, P<.001, and P=.049, respectively). The interrater agreement between the 2 reviewers was substantial (k=0.78).ConclusionsThere is great heterogeneity in the quality of apps for patients with hematological conditions. More than half of the apps do not meet acceptable criteria for quality and content. Most of them only provide information about the pathology, lacking interactivity and personalization options. The participation of health professionals in the development of these apps is low, although it is narrowly related to better quality.

The Content, Quality, and Behavior Change Techniques in Nutrition-Themed Mobile Apps for Children in Canada: App Review and Evaluation Study.

BackgroundChildren increasingly use mobile apps. Strategies to increase child engagement with apps include the use of gamification and images that incite fun and interaction, such as food. However, the foods and beverages that children are exposed to while using apps are unknown and may vary by app type.ObjectiveThe aim of this study is to identify the app content (ie, types of foods and beverages) included in nutrition-themed apps intended for children, to assess the use of game-like features, and to examine app characteristics such as overall quality and behavior change techniques (BCTs).MethodsThis analysis used a cross-sectional database of nutrition-themed apps intended for children (≤12 years), collected between May 2018 and June 2019 from the Apple App Store and Google Play Store (n=259). Apps were classified into four types: food games or nongames that included didactic nutrition guides, habit trackers, and other. Food and beverages were identified in apps and classified into 16 food categories, as recommended (8/16, 50%) and as not recommended (8/16, 50%) by dietary guidelines, and quantified by app type. Binomial logistic regression assessed whether game apps were associated with foods and beverages not recommended by guidelines. App quality, overall and by subscales, was determined using the Mobile App Rating Scale. The BCT Taxonomy was used to classify the different behavioral techniques that were identified in a subsample of apps (124/259, 47.9%).ResultsA total of 259 apps displayed a median of 6 (IQR 3) foods and beverages. Moreover, 62.5% (162/259) of apps were classified as food games, 27.4% (71/259) as didactic nutrition guides, 6.6% (17/259) as habit trackers, and 3.5% (9/259) as other. Most apps (198/259, 76.4%) displayed at least one food or beverage that was not recommended by the dietary guidelines. Food game apps were almost 3 times more likely to display food and beverages not recommended by the guidelines compared with nongame apps (β=2.8; P<.001). The overall app quality was moderate, with a median Mobile App Rating Scale score of 3.6 (IQR 0.7). Functionality was the subscale with the highest score (median 4, IQR 0.3). Nutrition guides were more likely to be educational and contain informative content on healthy eating (score 3.7), compared with the other app types, although they also scored significantly lower in engagement (score 2.3). Most apps (105/124, 84.7%) displayed at least one BCT, with the most common BCT being information about health consequences.ConclusionsFindings suggest nutrition-themed apps intended for children displayed food and beverage content not recommended by dietary guidelines, with gaming apps more likely to display not recommended foods than their nongame counterparts. Many apps have a moderate app quality, and the use of consequences (instead of rewards) was the most common BCT.

An investigation of mobile health (mHealth) applications available to support knee arthroplasty rehabilitation and recommendations for implementation: A scoping review

Keywords: mHealth; Applications; Arthroplasty Purpose: Length of hospital-stay following total knee arthroplasty (TKA) is approximately 1-3 days, with associated costs of revisions around £75,000 per patient. Patient control of recovery, self-management and compliance to home-based rehabilitation is therefore of utmost importance. The use of mHealth applications (apps), to promote independence and self-management, provides potential for a cost-effective, patient-centred strategy to achieve this. The objective of this study was to scope and review the quality of publicly available, patient-focused apps for TKA, with the aim of identifying and recommending one for trial and clinical implementation within a Hampshire hospital. Methods: A scoping review was chosen to systematically map, synthesise and review the latitude of apps available via the Apple Store and Google Play. Apps were identified if they were free of charge to the user, suitable for use within the UK and in English; due to the ubiquitous nature of app usage, apps were selected if they targeted both total knee or hip arthroplasty. Quality analysis of each app was conducted using the Mobile App Rating Scale (MARS); a simple 4-dimension, objective, and reliable tool for classifying and assessing quality of mhealth apps. Results: Nine apps, from 692 screened, met the inclusion criteria and were reviewed using MARS. The mean overall MARS score (where 1 = inadequate and 5 = excellent) was 3.57 (SD = ±0.87). Four apps had a score above 4, three of which were identified as utilising an app platform already in use by NHS Trusts. Five apps had a score of less than 3. The highest rated app was the Northumbria Orthopaedic NHS Trust App (4.57) which utilised the app platform ‘My Patient Journey’. This app was noted to consider features that ensured the app was engaging and also likely to promote positive rehabilitative behaviours. Conclusion(s): This study provides an overview of mHealth apps available to health-care professionals and patients post-TKA. Further investigation into the use of this platform is required, to personalise and adjust it for specific Trust use. Randomised trials are now required in order to characterise the use and efficacy of this app on health knowledge, behaviours and use. Moreover, to understand their effectiveness in rehabilitation and improve quality of life following TKA, hereby reducing its burden on public health and clinical systems. Impact: The NHS finds itself in the midst of an mHealth revolution and mobile technology offers the opportunity to access clinical apps, evidence-based resources and advanced mobile communication in one device. The mobility of such apps enables patients to use them in their home setting, reducing the need for face-to-face contact and, in light of the COVID-19 pandemic, has shown itself to be a technology that presents a future healthcare option. This study provides an overview of the mHealth apps available to a range of health-care professionals across all disciplines and patients post-TKA surgery; summarising their strengths and limitations to make recommendations for future implementation. The introduction of such management will take time, funding, a shift in clinician approach and patient expectation-management, in addition to further research to optimise delivery. Funding acknowledgements: This study is a final year physiotherapy dissertation, courtesy of University of Winchester. No funding was received from internal/external sources.

User Experience, Engagement, and Popularity in Mental Health Apps: Secondary Analysis of App Analytics and Expert App Reviews.

BackgroundUser experience and engagement are critical elements of mental health apps’ abilities to support users. However, work examining the relationships among user experience, engagement, and popularity has been limited. Understanding how user experience relates to engagement with and popularity of mental health apps can demonstrate the relationship between subjective and objective measures of app use. In turn, this may inform efforts to develop more effective and appealing mental health apps and ensure that they reach wide audiences.ObjectiveWe aimed to examine the relationship among subjective measures of user experience, objective measures of popularity, and engagement in mental health apps.MethodsWe conducted a preregistered secondary data analysis in a sample of 56 mental health apps. To measure user experience, we used expert ratings on the Mobile App Rating Scale (MARS) and consumer ratings from the Apple App Store and Google Play. To measure engagement, we acquired estimates of monthly active users (MAU) and user retention. To measure app popularity, we used download count, total app revenue, and MAU again.ResultsMARS total score was moderately positively correlated with app-level revenue (Kendall rank [T]=0.30, P=.002), MAU (T=0.39, P<.001), and downloads (T=0.41, P<.001). However, the MARS total score and each of its subscales (Engagement, Functionality, Aesthetics, and Information) showed extremely small correlations with user retention 1, 7, and 30 days after downloading. Furthermore, the total MARS score only correlated with app store rating at T=0.12, which, at P=.20, did not meet our threshold for significance.ConclusionsMore popular mental health apps receive better ratings of user experience than less popular ones. However, user experience does not predict sustained engagement with mental health apps. Thus, mental health app developers and evaluators need to better understand user experience and engagement, as well as to define sustained engagement, what leads to it, and how to create products that achieve it. This understanding might be supported by better collaboration between industry and academic teams to advance a science of engagement.

Multipurpose Mobile Apps for Mental Health in Chinese App Stores: Content Analysis and Quality Evaluation.

BackgroundMental disorders impose varying degrees of burden on patients and their surroundings. However, people are reluctant to take the initiative to seek mental health services because of the uneven distribution of resources and stigmatization. Thus, mobile apps are considered an effective way to eliminate these obstacles and improve mental health awareness.ObjectiveThis study aims to evaluate the quality, function, privacy measures, and evidence-based and professional background of multipurpose mental health apps in Chinese commercial app stores.MethodsA systematic search was conducted on iOS and Android platforms in China to identify multipurpose mental health apps. Two independent reviewers evaluated the identified mobile apps using the Mobile App Rating Scale (MARS). Each app was downloaded, and the general characteristics, privacy and security measures, development background, and functional characteristics of each app were evaluated.ResultsA total of 40 apps were analyzed, of which 35 (87.5%) were developed by companies and 33 (82.5%) provided links to access the privacy policy; 21 (52.5%) apps did not mention the involvement of relevant professionals or the guidance of a scientific basis in the app development process. The main built-in functions of these apps include psychological education (38/40, 95%), self-assessment (34/40, 85%), and counseling (33/40, 82.5%). The overall quality average MARS score of the 40 apps was 3.54 (SD 0.39), and the total score was between 2.96 and 4.30. The total MARS score was significantly positively correlated with the scores of each subscale (r=0.62-0.88, P<.001). However, the user score of the app market was not significantly correlated with the total MARS score (r=0.17, P=.33).ConclusionsThe quality of multipurpose mental health apps in China’s main app market is generally good. However, health professionals are less involved in the development of these apps, and the privacy protection policy of the apps also needs to be described in more detail. This study provides a reference for the development of multipurpose mental health apps.

A systematic review of dialectical behavior therapy mobile apps for content and usability

BackgroundThe gap between treatment need and treatment availability is particularly wide for individuals seeking Dialectical Behavior Therapy (DBT), and mobile apps based on DBT may be useful in increasing access to care and augmenting in-person DBT. This review examines DBT based apps, with a specific focus on content quality and usability.MethodsAll apps referring to DBT were identified in Google Play and iOS app stores and were systematically reviewed for app content and quality. The Mobile App Rating Scale (MARS) was used to evaluate app usability and engagement.ResultsA total of 21 free to download apps were identified. The majority of apps (71%) included a component of skills training, five apps included a diary card feature. Most (76.19%) apps were designed to function without help from a therapist. The average user “star” rating was 4.39 out of 5. The mean overall MARS score was 3.41, with a range of 2.15 to 4.59, and 71.43% were considered minimally ‘acceptable,’ as defined by a score of 3 or higher. The average star rating was correlated with the total MARS score (r = .51, p = .02). Estimates of app usage differed substantially between popular and unpopular apps, with the three most popular apps accounting for 89.3% of monthly active users.ConclusionsWhile the present study identified many usable and engaging apps in app stores designed based on DBT, there are limited apps for clinicians. DBT based mobile apps should be carefully developed and clinically evaluated.

Analysis of Apps With a Medication List Functionality for Older Adults With Heart Failure Using the Mobile App Rating Scale and the IMS Institute for Healthcare Informatics Functionality Score: Evaluation Study.

BackgroundManaging the care of older adults with heart failure (HF) largely centers on medication management. Because of frequent medication or dosing changes, an app that supports these older adults in keeping an up-to-date list of medications could be advantageous. During the COVID-19 pandemic, HF outpatient consultations are taking place virtually or by telephone. An app with the capability to share a patient’s medication list with health care professionals before consultation could support clinical efficiency, for example, by reducing consultation time. However, the influence of apps on maintaining an up-to-date medication history for older adults with HF in Ireland remains largely unexplored.ObjectiveThe aims of this review are twofold: to review apps with a medication list functionality and to assess the quality of the apps included in the review using the Mobile App Rating Scale (MARS) and the IMS Institute for Healthcare Informatics functionality scale.MethodsA systematic search of apps was conducted in June 2019 using the Google Play Store and iTunes App Store. The MARS was used independently by 4 researchers to assess the quality of the apps using an Android phone and an iPad. Apps were also evaluated using the IMS Institute for Healthcare Informatics functionality score.ResultsGoogle Play and iTunes App store searches identified 483 potential apps (292 from Google Play and 191 from iTunes App stores). A total of 6 apps (3 across both stores) met the inclusion criteria. Of the 6 apps, 4 achieved an acceptable MARS score (3/5). The Medisafe app had the highest overall MARS score (4/5), and the Medication List & Medical Records app had the lowest overall score (2.5/5). On average, the apps had 8 functions based on the IMS functionality criteria (range 5-11). A total of 2 apps achieved the maximum score for number of features (11 features) according to the IMS Institute for Healthcare Informatics functionality score, and 2 scored the lowest (5 features). Peer-reviewed publications were identified for 3 of the apps.ConclusionsThe quality of current apps with medication list functionality varies according to their technical aspects. Most of the apps reviewed have an acceptable MARS objective quality (ie, the overall quality of an app). However, subjective quality (ie, satisfaction with the apps) was poor. Only 3 apps are based on scientific evidence and have been tested previously. A total of 2 apps featured all the IMS Institute for Healthcare Informatics functionalities, and half did not provide clear instructions on how to enter medication data, did not display vital parameter data in an easy-to-understand format, and did not guide users on how or when to take their medication.

APLIKASI MHEALTH COVID-19 DI INDONESIA: ANALISIS KONTEN MENGGUNAKAN MOBILE APLICATION RATING SCALE (MARS)

It has been a year since the first COVID-19 cases in Indonesia and the development of COVID-19 health applications has grown significantly during that time. However, there has not been found research to analyze such an application in Indonesia. This study aims to evaluate the mHealth COVID-19 application in Indonesia application store, which will eventually become a reference for all researchers related to the mhealth application development in Indonesia. The researchers used COVID-19-related keywords to identify apps on iOS and Android devices. There were 17 applications selected for this research, and the applications' quality were assessed by two coders using the Mobile App Rating Scale (MARS). The search results totaled 842 applications, 19 of which met the researcher's criteria, and 17 applications were found to be assessed. This research was using the Krippendorff coefficient alpha (α) to calculate the reliability value of the agreement between coders. The result showed that PeduliLindungi applications had the highest (4.2/5) of the average MARS score, and the MARS scores of 14 applications were unacceptable (&lt;3.0), which explained that most of the COVID-19 related apps in Indonesia are of low quality. Also, this research implies that the information-related features should be the next focus for overall quality improvement of the Indonesian mHealth application in the future.

Personalized and Self-Management: Systematic Search and Evaluation Quality Factors and User Preference of Drug Reference Apps in Taiwan.

Background: Drug reference apps promote self-management and improve the efficiency and quality of work for physicians, nurses, pharmacists, and patients. This study aimed to describe a systematic and stepwise process to identify drug reference apps in Taiwan, assess the quality of these apps, and analyze the influential factors for user ratings. Methods: A two-step algorithm (KESS) consisting of keyword growing and systematic search was proposed. Seven independent reviewers were trained to evaluate these apps using Mobile App Rating Scale (MARS). A logistic regression model was fitted and average marginal effects (AME) were calculated to identify the effects of factors for higher user ratings. Results: A total of 23 drug reference apps in Taiwan were identified and analyzed. Generally, these drug reference apps were evaluated as acceptable quality with an average MARS score of 3.23. Higher user engagement, more functionality, better aesthetics, and more information associated with higher user ratings. Navigation is the most influential factor on higher user ratings (AME: 13.15%) followed by performance (AME: 11.03%), visual appeal (AME: 10.87%), credibility (AME: 10.67%), and quantity of information (AME: 10.42%). Conclusions: User experience and information clearly affect user ratings of drug reference apps. Five key factors should be considered when designing drug reference apps.

User Engagement and Usability of Suicide Prevention Apps: Systematic Search in App Stores and Content Analysis.

BackgroundPeople with suicidal thoughts are more inclined to seek technology-delivered interventions than in-person forms of treatment, making mobile apps for suicide prevention an ideal platform for treatment delivery. This review examines apps designed for suicide prevention, with a specific focus on user engagement.ObjectiveThis study aims to update the literature and broadly evaluate the landscape of mobile health apps for suicide prevention; examine apps with key features and primary approaches to suicide prevention; and systematically evaluate the engagement, functionality, aesthetics, and information of the apps.MethodsAll apps related to suicidal thoughts and behaviors were identified in the Google Play and iOS app stores and were systematically reviewed for their content and quality. The mobile app rating scale (MARS) was used to evaluate app usability and engagement.ResultsOf the 66 apps identified, 42 (64%) were specifically designed for people with suicidal ideation, and 59 (89%) had at least one best practice feature for suicide risk reduction. The mean overall MARS score of all apps was 3.5 (range 2.1-4.5), with 83% (55/66) of apps having a minimum acceptability score of 3. The total MARS score was not associated with the user app rating (r=−0.001; P=.99) or the number of features (r=0.24; P=.09).ConclusionsThis study identified many usable and engaging apps in app stores designed for suicide prevention. However, there are only limited apps for clinicians. Thus, mobile apps for suicide prevention should be carefully developed and clinically evaluated.

Systematic Review and Scientific Rating of Commercial Apps Available in India for Diabetes Prevention

Objectives: We aimed to evaluate the quality of currently available health apps for prevention of type 2 diabetes among Asian Indians using validated rating scales. Materials and Methods: Using the keywords, “diabetes prevention,” “healthy lifestyle,” and “fitness,” a total of 1486 apps available in India via Google Play were assessed for eligibility by two independent reviewers. After initial screening using specific inclusion and exclusion criteria, 50 apps underwent a pre-specified rating based on user reviews, number of downloads, and app size. Sixteen apps that scored ≥ 9 were shortlisted for further review using the Mobile App Rating Scale (MARS). The mean MARS scores (for categories I and II) were used to identify the top ranked apps. Results: The mean score for Category I of MARS rating was highest for “Google Fit: Health and Activity Tracking” (4.55/5). This was followed by “Healthifyme—Diet Plan, Health, and Weight Loss” (4.45/5). For Category II of MARS, “Diabetes M,” “Google Fit: Health and Activity Tracking,” “Calorie Counter—My Fitness Pal,” and “Healthifyme—Diet Plan, Health, and Weight Loss” all scored equally well. On comparing the advantages and disadvantages of each of these applications, “Google Fit: Health and Activity Tracking” and “Healthifyme—Diet Plan, Health, and Weight Loss” again ranked the best. Conclusion: Our review identifies two commercially available apps “Google Fit: Health and Activity Tracking” and “Healthifyme—Diet Plan, Health, and Weight Loss” as being user friendly and good quality. Although encouraging, further research is needed to evaluate the efficacy of these apps for the prevention of diabetes.

Sticky apps, not sticky hands: A systematic review and content synthesis of hand hygiene mobile apps.

The study sought to identify smartphone apps that support hand hygiene practice and to assess their content, technical and functional features, and quality. A secondary objective was to make design and research recommendations for future apps. We searched the UK Google Play and Apple App stores for hand hygiene smartphone apps aimed at adults. Information regarding content, technical and functional features was extracted and summarized. Two raters evaluated each app, using the IMS Institute for Healthcare Informatics functionality score and the Mobile App Rating Scale (MARS). A total of 668 apps were identified, with 90 meeting the inclusion criteria. Most (96%) were free to download. The majority (78%) intended to educate or inform or remind users to hand wash (69%), using behavior change techniques such as personalization and prompting practice. Only 20% and 4% named a best practice guideline or had expert involvement in development, respectively. Innovative means of engagement were used in 42% (eg, virtual or augmented reality or geolocation-based reminders). Apps included an average of 2.4 out of 10 of the IMS functionality criteria (range, 0-8). The mean MARS score was 3.2 ± 0.5 out of 5, and 68% had a minimum acceptability score of 3. Two had been tested or trialed. Although many hand hygiene apps exist, few provide content on best practice. Many did not meet the minimum acceptability criterion for quality or were formally trialed or tested. Research should assess the feasibility and effectiveness of hand hygiene apps (especially within healthcare settings), including when and how they "work." We recommend that future apps to support hand hygiene practice are developed with infection prevention and control experts and align with best practice. Robust research is needed to determine which innovative methods of engagement create "sticky" apps.

Mobile Apps for Drug-Drug Interaction Checks in Chinese App Stores: Systematic Review and Content Analysis.

BackgroundAs a computerized drug–drug interaction (DDI) alert system has not been widely implemented in China, health care providers are relying on mobile health (mHealth) apps as references for checking drug information, including DDIs.ObjectiveThe main objective of this study was to evaluate the quality and content of mHealth apps supporting DDI checking in Chinese app stores.MethodsA systematic review was carried out in November 2020 to identify mHealth apps providing DDI checking in both Chinese iOS and Android platforms. We extracted the apps’ general information (including the developer, operating system, costs, release date, size, number of downloads, and average rating), scientific or clinical basis, and accountability, based on a multidimensional framework for evaluation of apps. The quality of mHealth apps was evaluated by using the Mobile App Rating Scale (MARS). Descriptive statistics, including numbers and percentages, were calculated to describe the characteristics of the apps. For each app selected for evaluation, the section-specific MARS scores were calculated by taking the arithmetic mean, while the overall MARS score was described as the arithmetic mean of the section scores. In addition, the Cohen kappa (κ) statistic was used to evaluate the interrater agreement.ResultsA total of 7 apps met the selection criteria, and only 3 included citations. The average rating score for Android apps was 3.5, with a minimum of 1.0 and a maximum of 4.9, while the average rating score for iOS apps was 4.7, with a minimum of 4.2 and a maximum of 4.9. The mean MARS score was 3.69 out of 5 (95% CI 3.34-4.04), with the lowest score of 1.96 for Medication Guidelines and the highest score of 4.27 for MCDEX mobile. The greatest variation was observed in the information section, which ranged from 1.41 to 4.60. The functionality section showed the highest mean score of 4.05 (95% CI 3.71-4.40), whereas the engagement section resulted in the lowest average score of 3.16 (95% CI 2.81-3.51). For the information quality section, which was the focus of this analysis, the average score was 3.42, with the MCDEX mobile app having the highest score of 4.6 and the Medication Guidelines app having the lowest score of 1.9. For the overall MARS score, the Cohen interrater κ was 0.354 (95% CI 0.236-0.473), the Fleiss κ was 0.353 (95% CI, 0.234-0.472), and the Krippendorff α was 0.356 (95% CI 0.237-0.475).ConclusionsThis study systematically reviewed the mHealth apps in China with a DDI check feature. The majority of investigated apps demonstrated high quality with accurate and comprehensive information on DDIs. However, a few of the apps that had a massive number of downloads in the Chinese market provided incorrect information. Given these apps might be used by health care providers for checking potential DDIs, this creates a substantial threat to patient safety.

Behavior Change Techniques in Popular Mobile Apps for Smoking Cessation in France: Content Analysis.

BackgroundThe mobile app market differs from country to country, and to date, no previous review of the content quality of smoking cessation apps has been conducted in France.ObjectiveThis study aimed to examine the general quality of the most popular smoking cessation apps in France and also determine the degree to which apps adhere to established behavioral and cognitive techniques (BCTs) proven effective in clinical practice.MethodsA systematic research of smoking cessation apps was conducted in both the Google Play Store and Apple Store in the French market. The general quality of popular apps was rated with the Mobile App Rating Scale (MARS), and the therapeutic quality was assessed with the ratio of adherence of the behavior change technique taxonomy for smoking cessation treatment.ResultsA total of 14 mobile apps met all the inclusion criteria of the content analysis. The interrater reliability varied from “substantial” (0.79) to “almost perfect” (0.9) for the two measures. The mean MARS score was 3.5 out of 5 (median 3.6, IQR 0.6 [3.2-3.8]). The findings suggest that popular apps focus primarily on the functionality dimension of the MARS scale (4.2/5). The mean number of BCTs was 22, with a large difference between apps (minimum 4, maximum 38). At least half of the apps addressed motivation (8.8/14, 63%) and advised on using behavioral skills in order to quit smoking or stay a nonsmoker (8.7/14, 62%). However, only a handful of apps gathered important information (5.9/14, 42%) in order to deliver proper advice regarding the use of approved medication or the implementation of behavioral techniques (4.3/14, 31%). The mean MARS score was positively correlated with the price (r=0.70, P=.007) and the number of BCTs used (r=0.67, P=.01). User rating was not correlated with any quality scale (P=.67).ConclusionsThe content quality of popular smoking cessation apps in France varied by app type and price. Most popular apps propose in general good quality content but lack implementation of evidence-based BCTs associated with effectiveness on smoking cessation treatment. Further research is needed to evaluate the improvement in the content quality of smoking cessation apps in France.