Use Of Questionnaire Research Articles

Usability of a smartphone application for patients with interstitial lung disease: Results from the Registry for Better Understanding of ILD (RE-BUILD) pilot study.

Digital technologies offer opportunities for remote monitoring, increased patient engagement and incorporation of patient-reported outcome measures (PROMs) into interstitial lung disease (ILD) care and research. This study evaluated the usability and patient experience of the RE-BUILD (Registry for Better Understanding of ILD) application, an ILD-specific smartphone app. Patients with ILD aged ≥18 years were recruited from three tertiary ILD centres to use the RE-BUILD app for 6 months. The mHealth App Usability Questionnaire (MAUQ) was evaluated at 1, 3 and 6 months and patients received monthly prompts to enter clinical and PROM data. Qualitative interviews regarding patient experience were performed in a subset of 10. Fifty patients, with mean age 66.9 ± 10.3 years, 25 (50%) female were included. Participants used the app for a median of 48 (IQR 21-178.3) sessions, equivalent to 8 sessions (IQR 3.5-29.71) per month. Median number of days that the app was accessed was 37 (IQR 14-96.8), with 13 (26%) patients using the app >30 times per month. The most accessed app feature was physical activity, followed by 'air quality'. Participants agreed or strongly agreed that the app was easy to use (76.0%) easy to learn to use (79.8%) and well-organized with accessible information (74.8%). The median overall MAUQ score for usability was 5.69 (IQR 5.03-6.19). There was also a high rate of engagement with app functionalities. RE-BUILD is a usable and intuitive platform for self-monitoring and data collection in ILD. Patients report a high degree of satisfaction and have provided valuable feedback for its further development.

Design and Evaluation of a Mobile Health Application for Self-Care of Diabetic Retinopathy Patients: Participatory Design Study

Background: Diabetic retinopathy (DR) is a significant complication of diabetes, potentially leading to vision loss. Effective self-care and management are crucial to prevent its progression. Mobile Health (mHealth) applications offer a promising solution for supporting DR patients in self-care by providing continuous monitoring, education, and reminders. Objectives: This Participatory Design study aimed to create and assess a mobile health app to help diabetic retinopathy patients manage their condition through self-care. Methods: This practical research was carried out in 2024 over two stages: Design and Evaluation. First, we determined the functional requirements and developed a conceptual model of the application using Microsoft Visio 2021. In the next stage, we evaluated the application using the Mobile Application Usability Questionnaire (MAUQ) and gathered feedback from patients with diabetic retinopathy to understand their views on the application's usability. Results: The application's main features included reminders, alerts, educational content, and useful links. Thirty users with diabetic retinopathy participated in the usability testing. The participants expressed a high level of satisfaction with the application (mean score: 5.67 ± 1.04 out of a maximum of 7.00). Conclusions: The mHealth application for diabetic retinopathy self-care demonstrated high usability and potential to support patients in managing their condition. Future work should focus on integrating more advanced features and conducting long-term studies to assess the app's impact on clinical outcomes.

Comparative Analysis of Generative AI Tools in Making Marketing Copywriting in the Era of New Media

In the background of the development of new media, generative Artificial Intelligence (AI) tools have become powerful assets to create marketing copywriting, which provides efficiency and innovation ability for the generation of content. This study analyzes the performance of 4 types of AI tools ChatGPT4o, Image-TO-Prompt-AI(Poe), Tiangong3.0 and Doubao when producing and promoting copywriting. The study discussed the performance of these AI to generate the text which can cause emotional resonance, capture key marketing elements and show special language style. By applying the BROKE instruction framework, this study ensures that the evaluation method of AI-generated content is consistent and structured. Research results reveal significant differences in content quality through user feedback and questionnaire collection, among them, ChatGPT4o is leading in overall attractiveness and TianGong3.0 has an outstanding performance on the unique perspective and logical structure. This study not only provides insights into the current capabilities of AI in content creation, but also lays the foundation for the future development of AI and artificial collaboration in the new media field.

Integrating Telemedicine in Botulinum Toxin Type-A Treatment for Spasticity Management: Perspectives and Challenges from Italian Healthcare Professionals

(1) Background: Telemedicine is a vital tool for enhancing healthcare accessibility and outcomes at reduced costs. This study aimed to assess the usability of the Maia Connected Care telemedicine platform for managing spasticity in patients receiving botulinum toxin type-A, focusing on the perspectives of Italian physiatrists with expertise in this treatment. (2) Methods: Conducted from March 2023 to June 2023, this multicenter survey involved 15 Italian physicians who used the platform for teleconsultations. Data collected included demographic details, responses to the Telemedicine Usability Questionnaire, and physician insights on patient satisfaction, treatment effectiveness, and implementation challenges in telehealth. (3) Results: The platform demonstrated high usability, with strong physician satisfaction due to its user-friendly interface and quality of interactions. A majority expressed willingness to continue telehealth for spasticity management, noting its effectiveness in improving patient satisfaction and outcomes. Challenges included replicating the depth of in-person consultations and addressing issues like reimbursement and telehealth standardization. (4) Conclusions: This study highlights telemedicine’s potential for spasticity management and clinician satisfaction, while underscoring the need for improvements in simulating in-person experiences and addressing systemic issues. The absence of patient perspectives represents a limitation, advocating for future research to optimize telemedicine practices and evaluate long-term clinical impacts.

Perceived usability and acceptability of the my-hip fracture risk communication tool from the perspective of academic clinicians

ObjectiveWe evaluated the usability and acceptability of My-Hip Fracture (My-HF), a web application that assists providers in delivering individualized prognostic information to patients hospitalized for hip fracture (HF). MethodsWe observed a sample of 16 clinicians as they navigated My-HF. We then administered a structured questionnaire and conducted semi-structured interviews to explore participants' opinions about the app's content and the feasibility of incorporating the app into clinical workflows. ResultsClinicians required a median of 2-min and 45 s to navigate through the app. Nearly all participants indicated that My-HF was easy to use and would be useful for their practice. About half of participants had suggestions for additional useful peri-operative content. A few expressed concerns about communicating mortality risk. About half expressed concerns about how My-HF might be integrated into existing clinical workflows. ConclusionsThough clinicians rated My-HF high on usefulness in a structured usability questionnaire, qualitative interviews identified a number of suggestions for optimizing integration into clinical practice. Creating shared goals, establishing a decision coach, and developing a framework of communication across care settings could facilitate integration of My-HF by the multidisciplinary HF team. InnovationMy-Hip Fracture is a unique web application which provides personalized prognostic information to patients and families after HF. My-HF has potential to facilitate informed decision-making between clinicians and patients, but adaptations will be necessary to enhance its usability.

Telehealth in Gynecologic Oncology Clinical Trials

OBJECTIVE: To describe patient, research staff, and clinician perspectives regarding the effects of telehealth and remote clinical trial operations on safety, quality, and experience in gynecologic oncology clinical trials. METHODS: This qualitative study used semistructured interviews conducted from May to June 2022 with purposively sampled clinical trial participants, research staff, and clinicians involved in gynecologic oncology clinical trials with telehealth utilization. Participants described telehealth in clinical trial experiences, including benefits and barriers to receipt and provision of care, satisfaction, and quality. Transcripts were coded and analyzed with a modified content analysis approach based on research objectives and emergent themes. An adapted version of the validated Telehealth Usability Questionnaire was administered to all invited participants. RESULTS: Five patients, seven clinicians, and five research staff were interviewed. Patients and clinicians reported that telehealth, remote testing, and medication delivery positively affected quality of life by reducing financial burden, wait times, and transportation needs. Interviewees did not report telehealth-related changes in treatment-related adverse effects, referrals for urgent evaluation, or compromise of privacy but expressed concerns about the lack of physical examinations. Patients reported that telehealth increased scheduling burden without negative effects on care quality, counseling comprehension, relationships with trial teams, or satisfaction. Clinicians and research staff reported improved workflows regarding remote consent, sponsor interactions, and documentation but challenges with virtual patient education and off-site testing. Clinicians highlighted disparities for patients with limited technology access and reported institutional and insurance-based telehealth policies as barriers. Survey responses supported qualitative findings. CONCLUSION: Despite notable limitations, patients, research staff, and clinicians recommended continued utilization of telehealth and remote clinical trial operations in clinical trials. Future clinical trial designs should consider telehealth inclusion.

The Impact of a New Specialized Learning Platform on Enhancing Students’ Skills in Designing and Producing Online Educational Talking Books

The use of digital audio-based learning applications in classrooms is increasing. Thus, instructional technology professionals need to become more skilled in designing and developing these apps. To succeed in the future learning process, students studying instructional technology need to have mastered these skills. This study aims to examine the impact of a specialized platform proposed to cultivate students’ skills in easily designing and producing online educational talking books (online ETBs). To improve the target abilities, we developed a new specialized platform as a web-based system for this investigation that includes several innovative tools and special learning content. The research design used was quasi-experimental. Thirty-two undergraduate students majoring in instructional technology who were in the third grade examined the proposed platform. With the pre-and post-test design, all participants were placed into one group. Three online instruments were used to gather the data: a performance observation card; a product evaluation card; and a usability questionnaire. According to the results, the suggested platform considerably increased the practical skills required to design and create an online ETB. Additionally, the proposed platform positively impacted the production of online ETB products with an acceptable proficiency level across various educational subjects. The customized platform has also proven to be a comfortable learning environment for the participating instructional technology students. This platform may be utilized as an ICT teaching tool to enhance instructional technology departments as it is appropriate for constructing online ETBs in various educational areas without coding barriers.

Effectiveness of Remote Yoga for the Global Population and Implications for Healthcare Integration: A Mixed-Method Global Cross-Sectional Study

Research on the effectiveness and implications of remote yoga for wellness and healthcare across global demographics remains insufficient, limiting its reliability for integration into healthcare interventions. This study explored the effectiveness and implications of remote yoga (teleyoga) delivery modalities compared to traditional in-person practices in the global population. Identifying gaps between traditional and contemporary practices is critical for gaining insights for optimising the integration of remote yoga delivery in healthcare. The study utilised a mixed-methods approach, combining qualitative data from expert interviews with quantitative data from a cross-sectional survey. The qualitative segment focused on identifying gaps in the real-world implications of remote yoga delivery, and the quantitative segment used the Telehealth Usability Questionnaire to measure the participants’ experiences and impact. A survey of 1,767 participants, 801 from India and 966 from the United States revealed a positive overall experience with remote yoga. The reliability subscale exhibited a lower positive experience, whereas the other five subscales consistently indicated positive responses. However, significant demographic differences were observed between participants from India and the United States, with significantly higher scores in India. This indicates that the usability and effectiveness of remote yoga require further improvement. This study uniquely addresses several key gaps related to remote yoga delivery using a large sample, mixed-methods approach, and comparing Eastern and Western perspectives to comprehensively assess its usability, satisfaction, and adaptability across diverse demographics. The comparative analysis conducted in this study is essential for enhancing remote yoga's design, usability, and effectiveness and supporting its reliability and validity for integration into mainstream healthcare. Moreover, this study proposes an original framework, Knowledge, Acceptance, Practices, Experiences, and Results (KAPER) designed to introduce systematic delivery and assessment of remote yoga.

Burnout crisis in Chinese radiology: will artificial intelligence help?

To assess the correlation between the use of artificial intelligence (AI) software and burnout in the radiology departments of hospitals in China. This study employed a cross-sectional research design. From February to July 2024, an online survey was conducted among radiologists and technicians at 68 public hospitals in China. The survey utilized general information questionnaires, the Maslach Burnout Inventory-Human Services Survey (MBI-HSS) scale, and a custom-designed AI usage questionnaire. This study analyzed the correlation between AI software usage and occupational burnout, and general information was included as a control variable in a multiple linear regression analysis. The analysis of survey data from 522 radiology staff revealed that 389 (74.5%) had used AI and that 252 (48.3%) had used it for more than 12 months. Only 133 (25.5%) had not yet adopted AI. Among the respondents, radiologists had a higher AI usage rate (82.0%) than technicians (only 59.9%). Furthermore, 344 (65.9%) of the respondents exhibited signs of burnout. The duration of AI software usage was significantly negatively correlated with overall burnout, yielding a Pearson correlation coefficient of -0.112 (p < 0.05). Multiple stepwise regression analysis revealed that salary satisfaction, night shifts, duration of AI usage, weekly working hours, having children, and professional rank were the main factors influencing occupational burnout (all p < 0.05). AI has the potential to significantly help mitigate occupational burnout among radiology staff. This study reveals the key role that AI plays in assisting radiology staff in their work. Questions Although we are aware that radiology staff burnout is intensifying, there is no quantitative research assessing whether artificial intelligence software can mitigate this occupational burnout. Findings The longer staff use deep learning-based artificial intelligence imaging software, the less severe their occupational burnout tends to be. This result is particularly evident among radiologists. Clinical relevance In China, radiologists and technicians experience high burnout rates. Even if there is an artificial intelligence usage controversy, encouraging the use of artificial intelligence software in radiology helps prevent and alleviate this occupational burnout.

PharmaLLM: A Medicine Prescriber Chatbot Exploiting Open-Source Large Language Models

AbstractThe increasing adoption of large language models (LLMs) in healthcare presents both opportunities and challenges. While LLM-powered applications are being utilized for various medical tasks, concerns persist regarding their accuracy and reliability, particularly when not specifically trained on medical data. Using open-source models without proper fine-tuning for medical applications can lead to inaccurate or potentially harmful advice, underscoring the need for domain-specific adaptation. Therefore, this study addresses these issues by developing PharmaLLM, a fine-tuned version of the open-source Llama 2 model, designed to provide accurate medicine prescription information. PharmaLLM incorporates a multi-modal input/output mechanism, supporting both text and speech, to enhance accessibility. The fine-tuning process utilized LoRA (Low-Rank Adaptation) with a rank of 16 for parameter-efficient fine-tuning. The learning rate was maintained at 2e-4 for stable adjustments, and a batch size of 12 was chosen to balance computational efficiency and learning effectiveness. The system demonstrated strong performance metrics, achieving 87% accuracy, 92.16% F1 score, 94% sensitivity, 66% specificity, and 90% precision. A usability study involving 33 participants was conducted to evaluate the system using the Chatbot Usability Questionnaire, focusing on error handling, response generation, navigation, and personality. Results from the questionnaire indicated that participants found the system easy to navigate and the responses useful and relevant. PharmaLLM aims to facilitate improved patient-physician interactions, particularly in areas with limited healthcare resources and low literacy rates. This research contributes to the advancement of medical informatics by offering a reliable, accessible web-based tool that benefits both patients and healthcare providers.

Real-world epilepsy monitoring with ultra long-term subcutaneous EEG: a 15-month prospective study.

Novel subcutaneous electroencephalography (sqEEG) systems enable prolonged, near-continuous cerebral monitoring in real-world conditions. Nevertheless, the feasibility, acceptability and overall clinical utility of these systems remains unclear. We report on the longest observational study using ultra long-term sqEEG to date. We conducted a 15-month prospective, observational study including ten adult people with treatment-resistant epilepsy. After device implantation, patients were asked to record sqEEG, to use an electronic seizure diary and to complete acceptability and usability questionnaires. sqEEG seizures were annotated visually, aided by automated detection. Seizure clustering was assessed via Fano Factor analysis and seizure periodicity at multiple timescales was investigated through circular statistics. Over a median duration of 438 days, ten patients recorded a median 18.8 hours/day, totalling 71,984 hours of real-world sqEEG data. Adherence and acceptability remained high throughout the study. While 754 sqEEG seizures were recorded across patients, over half (52%) of these were not reported in the patient diary. Of the 140 (27%) diary reports not associated with an identifiable sqEEG seizure, the majority (68%) were reported as seizures with preserved awareness. The sqEEG to diary F1 agreement score was highly variable, ranging from 0.06 to 0.97. Patient-specific patterns of seizure clustering and seizure periodicity were observed at multiple (circadian and multidien) timescales. We demonstrate feasibility and high acceptability of ultra long-term (months-years) sqEEG monitoring. These systems help provide real-world, more objective seizure counting compared to patient diaries. It is possible to monitor individual temporal fluctuations of seizure occurrence, including seizure cycles. [I do not have a X/Twitter handle]People with epilepsy may suffer from severe injuries or sudden death due to uncontrolled seizures. Many seizures remain unnoticed by people and unreported to doctors, despite these potentially catastrophic consequences. There is an urgent need to detect seizures more objectively. Our study used a novel device placed under the skin to monitor brainwave activity continuously, at home, for many months, in people with treatment-resistant epilepsy. By monitoring epilepsy from home, we detected many seizures unreported by patients, and we also found predictable patterns (cycles) of seizure occurrence over time. In the future, this type of monitoring could revolutionize epilepsy care, by improving safety, treatment management and reducing uncertainty in patients' daily lives.

Effectiveness of virtual reality application technology for mathematical creativity

As a development of metaverse technology, virtual reality (VR) application technology will be utilized to create a visual experience of abstract mathematical concepts and boost students' mathematical creativity in mathematics education. Thus, this study explores whether abstract mathematical concepts at the college level with VR application technology effectively foster students' mathematical creativity. Ninety-six students followed learning-based VR in mathematics education in Jakarta, Indonesia. The effectiveness of the VR experience was measured through indicators of immersive, interactive, focused attention, and imaginative experiences from the use of VR application technology. Meanwhile, mathematical creativity was measured by the flexibility and originality of students' ideas. Students will implement VR applications designed with 3D objects. After the implementation of the VR application, the creativity questionnaire and the VR technology usage questionnaire became data collection methods. Data analysis used multiple linear regression analysis. The study's results showed a positive impact of virtual reality application technology's immersive and interactive experience on the flexibility of students' mathematical ideas in enhancing mathematical creativity. On the other hand, focused attention and imaginative experiences from virtual reality application technology influenced the acquisition of originality of mathematical ideas in enhancing students' mathematical creativity. This study is essential because it identifies the effectiveness of virtual reality experiences in visualizing abstract mathematical concepts and improving students' mathematical creativity.

Leveraging Gamification in Science Learning for Secondary Students

This project aims to study the usefulness of incorporating gamification for science learning, for secondary school students. Ever since, the Science subject has been a hassle to the students, as well as the teachers. Therefore, a web-based system with gamification has been proposed. The waterfall model was chosen as the project's methodology, which consists of planning, analysis, design, implementation, testing, and documentation phases. Firebase was used as the cloud database to ease data storage and analysis. The selection was made to ensure the data from interactive activities such as watching films and doing exercises was securely gathered and used. Students earned points, badges, and were ranked as they performed assignments, adding a competitive element to the learning experience. A usability test was carried out to assess the success of the gamified learning platform using PSSUQ (Post-Study System Usability Questionnaire). The survey participants were chosen randomly from a group of high school students and teachers. After using the gamified website, they were asked to submit feedback by answering 16 constructed questions. Positive feedback was gathered from the survey, as most of the questions recorded mean values between 4.0 and 4.5. Hopefully, this study will provide further information regarding the effectiveness of gamification in learning, particularly in science learning for secondary students.

Usability Testing of the PACE-App to Support Family Caregivers in Managing Pain for People with Dementia.

Pain management is often suboptimal in individuals with dementia, and their family caregivers are tasked with supporting pain management despite limited preparation. The web-based PACE-app (PAin Control Enhancement) was designed to assist caregivers in managing pain for individuals with dementia. This study aimed to evaluate the usability of the PACE-app. A convergent parallel mixed-methods design was used to evaluate the PACE-app's usability with 16 family caregivers and 6 healthcare professionals. Quantitative data were collected using the Post-Study System Usability Questionnaire (PSSUQ), while qualitative data were gathered through guided app reviews and semi-structured interviews. Quantitative data were analyzed descriptively, and qualitative data were thematically coded. The PSSUQ results indicated that both family caregivers and healthcare professionals had a highly positive experience with the PACE-app: overall scores (2.01 vs. 1.68), system usefulness (1.76 vs. 1.68), information quality (1.98 vs. 1.80), interface quality (2.30 vs. 1.60), and satisfaction (2.00 vs. 1.60) were rated on a 1-7 scale (with lower scores indicating better usability). Qualitative findings supported these results, with participants endorsing the PACE-app's usefulness, ease of use, learnability, effective information presentation, aesthetics, clear layout, and overall satisfaction. Participants also provided valuable feedback for improving information quality (enhancing clarity) and interface quality (real-time coaching on pain management). The study demonstrated favorable usability and strong satisfaction among family caregivers and healthcare professionals using the PACE-app. Incorporating participants' suggestions will guide enhancements to the app's information and interface, ensuring it better meets users' needs.

Descriptive study of patient outcome and satisfaction with telemedicine and physical consultation during and after the COVID-19 pandemic.

This study was conducted to assess patients' outcome and satisfaction with the eye care received with telemedicine and physical consultation at a tertiary care hospital during and after the coronavirus disease 2019 (COVID-19) pandemic. A descriptive study was carried out on 6052 patients who consulted for eye illness at a tertiary care hospital between April 2020 and December 2022. An outcome scoring system was developed and validated for the assessment of patient outcome after providing treatment on telemedicine consultation and physical consultation. Outcome scores for various symptoms were compared pretreatment and posttreatment. Telehealth Usability Questionnaire (TUQ) was used through an online survey to assess patients' satisfaction with teleophthalmology services during the COVID-19 pandemic. An 18-item Patient Satisfaction Questionnaire (PSQ-18) was used to assess the same with physical consultation. A total of 6052 patients were included in the study. Physical consultation group had 2485 patients (41.06%) and the telemedicine group had 3567 patients (58.93%). Male patients constituted 63.11% and females were 36.89%. There was a significant improvement in outcome scores for pain and redness in both physical and telemedicine consultation groups (P < 0.0001). All subgroups of TUQ had significantly high scores (including usefulness, ease of use and learnability, interface quality, interaction quality, and satisfaction and future use), except one subgroup (reliability). Uneducated patients were significantly more satisfied with telemedicine compared to educated patients (P = 0.044). Majority of patients expressed satisfaction with teleophthalmology services. The recent pandemic paved the way for the future integration of telemedicine in ophthalmology, especially if virtual eye examinations attain a higher level of reliability.

Effectiveness of Mini Shadow Puppet Media Storytelling Model to Develop Speaking Competence of Fifth-Grade Elementary School Student

Speaking is one of the language skills that must be mastered by every student, because speaking is a means of expressing ideas. In fact, speaking competence is given less attention by teachers in the learning process. The low speaking competence of elementary school students can be seen from several studies such as at SDN 36 Pontianak Kota, only 26% of 30 students have speaking competence in the good category, and SDN S4 Bandung, only 1% of SDN S4 Bandung students are said to be quite capable of retelling the fairy tales they have heard using their own words. This study aims to develop Mini Shadow Puppet learning media with Storytelling model to improve the speaking competence of elementary school students. This research uses the R&amp;D (Research &amp; Development) development method with the ADDIE (Analysis, Design, Development, Implementation, Evaluation) development model. The trial of learning media was conducted to 20 students of SD Muhammadiyah 1 Surakarta. The results of this research show that Mini Shadow Puppet media is valid and feasible to use, this is based on four validation results, namely media expert validation obtained at 75%, material expert validation obtained at 78%, and trials using media that show an increase in speaking competence by 9%. The results of the user questionnaire filled in by students obtained a value of 92.5% in the acceptable category. This shows that the solution using Mini Shadow Puppet media is effective for students.

Validated translation of telehealth and health app usability questionnaires to 8 European languages

Abstract International projects such as the Joint Action on strengthening eHealth including telemedicine and remote monitoring for health care systems for cancer prevention and care (eCAN) are implemented in countries with different languages, requiring validation of translations of standardized tools. Evaluation frameworks for telemedicine services necessarily include the patient’s perspective, i.a. on the service usability. Due to the lack of validated questionnaires in multiple European languages we sought to develop translation for the languages of the eCAN pilot countries. Based on literature review, we selected mHealth App Usability Questionnaire (MAUQ) and Telehealth Usability Questionnaire (TUQ) and developed a conceptual definition for each item. Next, we performed forward and back translation from English into the target languages, expert review, cognitive interview (CI) with 5-10 cancer or chronic disease patients per language/per questionnaire. Qualitative CI results were scored by 2 independent researchers for consistence of each item with conceptual definitions for final review by native speaker expert. We chose 8 languages (ES, GR, HU, IT, LT, NL, PT, SI) for validation. CI involved 48 respondents (29 females, 60%; 18 aged&amp;gt;60, 38%;23 higher education, 48%) for TUQ and 48 (22 females, 46%; 16 aged&amp;gt;60, 33%; 23 higher education, 48%) for MAUQ. Overall 872 (87%) of TUQ and 728 (84%) of MAUQ item answers were classified as consistent. In more than one language we identified concepts difficult to understand: consistent navigation when moving between screens, distinction between easy to use/learn, social settings. The validation process allowed us to identify opportunities to improve translation and highlighted concepts generally more difficult to understand. We provided validated translation of MAUQ and TUQ in 8 European languages for use in eCAN pilots and future telemedicine evaluation studies. Key messages • eCAN successfully validated translations of telemedicine usability questionnaires for 8 languages. • Multilingual translation validation can provide insights into concepts difficult across languages.

Stakeholder involvement in the development of a serious game for and with healthcare professionals

Abstract Increasing pressure on the quality, accessibility and affordability of Dutch health services underlines the need for integrated approaches to healthcare that include lifestyle as preventive measure. Integrated healthcare requires coordinated collaboration between healthcare providers, which is facilitated by the concept of Positive Health as a unifying language. To support primary care providers (PCP) in developing knowledge and skills related to lifestyle as prevention, interdisciplinary collaboration and the concept of Positive Health, we are developing education in the form of a serious game: Game2Connect. Co-creation by active involvement of a consortium of educational institutes, healthcare organisations, a game developer, and PCP as end-users of Game2Connect plays a key role in its development. Data from interviews with PCP (on barriers and facilitators for health-promoting and collaborative behaviours), healthcare recipients (on input for case studies) and consortium meetings were incorporated into an initial version of Game2Connect, which is currently being piloted to assess and improve its utility and usability. Pilot sessions included an observed playthrough, followed by a usability questionnaire and a semi-structured group discussion. So far, 2 pilot sessions were held with consortium members (n = 16), and 3 sessions were held with PCP (n = 22). Learning indicators (e.g. PCP clarifying fellow players’ misconceptions) were observed in all sessions. Usability scores indicate high levels of challenge, content relevance, and positive affect, ranging between 3.3-3.6 on a 4-point scale. Qualitative feedback from group discussions resulted in the development of new case studies to appeal to a broader range of PCP, and the adjustment of a goal-setting exercise as a game component to encourage its use. These results suggest that serious gaming may be a viable and engaging method to educate PCP, especially when developed in active collaboration with stakeholders.

Design and Development of Interactive Moodle using Design Thinking to Support Online Learning

Moodle is an open-source learning management system (LMS) or e-learning platform that is designed to help educators create online courses with various features to facilitate learning. Interest in this research area has increased significantly in recent years, leading to an increasing number of schools employing this LMS. In the early stages of the development process, schools need to gain insights into user needs and generate new ideas for designing and developing interactive LMS. In this light, Design Thinking (DT) is viewed as an important approach. This study aimed to design and develop an online learning system based on Moodle to facilitate online learning for elementary school students. The objectives were to (1) design a system diagram, system architecture, and functional structure for facilitating online learning and (2) develop an interactive LMS using Moodle. The research methodology was conducted following the DT process. An evaluation was made to assess the usability of the system using the Computer System Usability Questionnaire (CSUQ). Across dimensions such as system quality, information quality, and interface quality, scores ranged between 5 and 7, highlighting a positive user perception across various aspects of the evaluation. These findings, therefore, offer practical guidance for educational stakeholders in adopting and promoting Moodle-based LMS.

Usability of a digital tool to support long-lasting insecticide net distribution in Northern Bahr el Ghazal State, South Sudan.

Long-lasting insecticidal nets (LLINs) have been a widely used malaria prevention method for decades. In South Sudan, LLINs are typically distributed by volunteers who use paper-based systems to collect distribution data. Paper-based systems are simple to use but have a higher occurrence of data inaccuracies and can hinder the timely use of data for decision-making. In 2022, a digital tool was introduced to collect data during the LLIN campaign in Northern Bahr el Ghazal (NBeG). The tool aimed to improve the accuracy of data entry and enable data to be used in real-time for decision making during the campaign. The digital tool was developed with offline functionality and interoperability with DHIS2 tracker version 2.8 in DHIS2 version 2.38. This study assessed the usability of the tool according to user perspectives. A questionnaire containing open- and closed-ended questions was conducted with users of the digital tool, supervisors and other key stakeholders in five counties of NBeG. The questionnaire was administered using Malaria Consortium's Projects Results System Android mobile application. Usability was determined through a modified and validated System Usability Scale (SUS) approach. A total of 93 participants responded to the usability questionnaire. The mean (± standard deviation) usability score across 10 SUS-scoring items was60.91 (12.87), indicating a modest level of usability. The majority of users agreed the tool was useful for managing the LLIN distribution workflow, was easy to use, reduced workload, and supported stock management and real-time campaign monitoring. There was no significant difference in the usability scores across genders, roles, and counties. Respondents with experience of both paper-based and the digital tool tended to express a preference for the digital tool over paper-based systems. The majority of respondents also reported they would recommend the digital tool to colleagues. Digital tools are perceived to improve data collection during LLIN campaigns, even in remote areas where network coverage is challenging. Additional improvements can be implemented to overcome operational challenges and improve usability of the tool. Further study is needed to assess the impact of the digital tool on data quality and real-time data use.