Chatbot para identificação e monitoramento de toxicidades associadas à quimioterapia antineoplásica em pacientes com câncer

ObjectiveThis study aimed to assess the content and face validity index of the development of the understanding, attitude, practice and health literacy questionnaire on COVID-19 (MUAPHQ C-19) in the Malay language.MethodsThe development of the MUAPHQ C-19 was conducted in two stages. Stage I resulted in the generation of the instrument’s items (development), and stage II resulted in the performance of the instrument’s items (judgement and quantification). Six-panel experts related to the study field and ten general public participated to evaluate the validity of the MUAPHQ C-19. The content validity index (CVI), content validity ratio (CVR) and face validity index (FVI) were analysed using Microsoft Excel.ResultsThere were 54 items and four domains, namely the understanding, attitude, practice and health literacy towards COVID-19, identified in the MUAPHQ C-19 (Version 1.0). The scale-level CVI (S-CVI/Ave) for every domain was above 0.9, which is considered acceptable. The CVR for all items was above 0.7, except for one item in the health literacy domain. Ten items were revised to improve the item’s clarity, and two items were deleted due to the low CVR value and redundancy, respectively. The I-FVI exceeded the cut-off value of 0.83 except for five items from the attitude domain and four from the practice domains. Thus, seven of these items were revised to increase the clarity of items, while another two were deleted due to low I-FVI scores. Otherwise, the S-FVI/Ave for every domain exceeded the cut-off point of 0.9, which is considered acceptable. Thus, 50-item MUAPHQ C-19 (Version 3.0) was generated following the content and face validity analysis.ConclusionsThe questionnaire development, content validity, and face validity process are lengthy and iterative. The assessment of the instruments’ items by the content experts and the respondents is essential to guarantee the instrument’s validity. Our content and face validity study has finalised the MUAPHQ C-19 version that is ready for the next phase of questionnaire validation, using Exploratory and Confirmatory Factor Analysis.

In the school environment, the need to perform first aid is common to meet the different demands presented by children. For this, education professionals need to be trained. The versatility of mobile applications in the learning process stands out among the qualification possibilities. The aim of the study was to validate the content, and appearance and evaluate the usability of a mobile application on first aid for basic education professionals. This methodological study was conducted virtually throughout Brazil, between September 2023 and April 2024. Content and appearance were validated by specialist experts (doctors [n = 10] and nurses [n = 24] working in pediatrics), using the Health Educational Content Validation Tool and the Health Educational Technology Appearance Validation Tool, and the usability was assessed with the target audience using the System Usability Scale. To test validity, a minimum agreement rate of 80% was adopted. Usability items with more than 75% of responses were considered satisfactory. Content and appearance validation was performed by 34 experts; in content validation, of the 14 items evaluated, 11 had the Content Validity Index per item (I-CVI) ≥ 0.91. In appearance validation, all items were evaluated with I-CVI ≥ 0.94. The total CVI was 0.93. A total of 109 primary education professionals conducted a usability evaluation, and they considered that 100% of the nine items were evaluated as satisfactory. The app "Criança and Cuidado - Aprenda primeiros socorros" (Child and Care - Learn first aid), which aims to teach first aid to primary school professionals, was considered valid in terms of its content and appearance. It showed good usability and satisfaction among the target audience.

Oncoped: A mobile application for health promotion in children and adolescents undergoing antineoplastic treatment.

This article describes the process of developing and validating a virtual assistant to perform vaccine pharmacovigilance. We performed a pilot study with a panel of 22 healthcare professionals who performed content validation of the virtual assistant prototype. Usability was tested with 126 users, using the System Usability Scale. The data analysis was performed by the agreement rate and content validity index, and the κ test was used to verify the agreement between the evaluators. The content domains of the virtual assistant achieved excellent suitability, relevance, and representativeness criteria, all greater than 86%; the content validity index ranged from 0.81 to 0.98, with an average of 0.90 and an interrater reliability index of 1.00. There was excellent interrater agreement (average κ value, 0.76). The total usability score among users was 80.1, ranging from 78.2 in group 1 (users without reactions to vaccines) to 82.1 in group 2 (users with reactions) ( P = .002). The virtual assistant for vaccine pharmacovigilance obtained a satisfactory level of content validity and usability, giving greater credibility to the claim that this device provides greater surveillance and safety for patients.

Emergency Departments (ED) are increasingly caring for patients with acute, chronic and terminal conditions requiring End of Life Care (EOLC). There is no published and validated tool available to evaluate EOLC delivery of patients dying in the ED. This study describes the face and content validity testing process to develop, refine and test a new and unique audit tool to evaluate EOLC in the ED. The face and content validation process used a three-round modified-Delphi technique. We consulted 11 experts to assess the proposed 89 items. Face validity explored the overall question of appropriateness and relevance; and content validity examined relevance ratings using the Content Validity Index (CVI) 4-point Likert scale in two rounds. Iterative assessment of ratings led to inclusion (CVI > 0.78), revision (CVI 0.65 to < 0.78) or exclusion (CVI < 0.65) of items from the tool. Of the initial 89 items, 66 were included (CVI > 0.78), 16 items revised (scores 0.65 to < 0.78), seven were removed (scores < 0.65) and two new items suggested. Items covered the constructs patient characteristics, circumstances of death, ED performance, communication and care planning, recognition of dying, care delivery, and needs of families and carers. Scale CVI achieved 0.90. The consolidated list of 81 items achieved acceptable face validity and excellent content validity. Face and content validity of the ED EOLC audit tool achieved acceptable item-CVI scores and an excellent scale-CVI score. We recommend external validation of its components in real-life settings to monitor and set locally relevant clinical practice benchmarks.

System Usability Scale (SUS) is a usability testing technique for a simple system using a Likert scale. Testing and usability analysis assess user satisfaction with the system or web. So, the purpose of this service activity is to train website usability testing with SUS, using the Dukcapil website as a test object. Dukcapil's website will be analyzed for its usability level as a real case for direct practice. In SUS, ten statements are used as parameters in assessing the usability of a website. This activity was attended by 20 people, including Bina Darma University students, vocational students, and IT staff from the Dukcapil Palembang City. The usability analysis of this website aims to assess how well user interaction with the website is going. Then, the results of this assessment and study produce an input as a reference for website development to be more optimal in the future. In testing the usefulness of the Dukcapil website in this PKM activity, it can be seen that the SUS score is at a score of 56.125, with the category Acceptable. Therefore, it shows that the Dukcapil website is ranked F, with a "Good" rating category. The training results show that the Dukcapil website is still very rarely accessed by users. Because it provides information lacking in updates, the features used are still in the beta version (still in the testing phase). Users or participants still do not understand how to use it. In addition, this activity provides participants with an understanding of the website usability test using the SUS model.

To analyze content validity evidence and response processes of a bank of items for measuring vulnerability to physical inactivity in adults. Methodological study, with 13 specialists and 46 representatives of the target population. The Content Validity Index (CVI) and binomial test were calculated; data obtained through validity based on response processes were collected through interviews. Of the 105 constructed items, 16 were excluded (CVI<0.78); 89 items showed agreement <80% in the psychometric criteria, being modified. Of the 101 items that remained (CVI>0.78), 34 were changed and 4 were deleted after evaluating the evidence of response processes. In the end, 97 items remained, with a global CVI of 0.92, organized into two dimensions: Subject (CVI=0.91) and Social (CVI=0.94). The items presented adequate parameters and evidence of validity; and can subsidize the construction of instruments that consider the subject's and social vulnerability in understanding physical inactivity.

Evaluation of methods used for estimating content validity.

Objective: This study aimed to determine the psychometric properties of sociocultural attitude towards appearance questionnaire in female adolescents. Method: This was a methodological study. The English version of the questionnaire was translated into Persian, using forward-backward method. Then the face validity, content validity and reliability were checked. To ensure face validity, the questionnaire was given to 25 female adolescents, a psychologist and three nurses, who were required to evaluate the items with respect to problems, ambiguity, relativity, proper terms and grammar, and understandability. For content validity, 15 experts in psychology and nursing, who met the inclusion criteria, were required. They were asked to assess the qualitative of content validity. To determine the quantitative content validity, content validity index and content validity ratio were calculated. At the end, internal consistency of the items was assessed, using Cronbach’s alpha method.Results: According to the expert judgments, content validity ratio was 0.81 and content validity index was 0.91. Besides, the reliability of the questionnaire was confirmed with Cronbach’s alpha = 0.91, and physical and developmental areas showed the highest reliability indices.Conclusion: The aforementioned questionnaire could be used in researches to assess female adolescents’ self-concept. This can be a stepping-stone towards identification of problems and improvement of adolescents’ body image.

BackgroundThe global aging population and the high incidence of falls among this population highlight the need for effective preventive strategies. Home-based exercise programs, such as the Otago protocol, have demonstrated efficacy in reducing fall risk but often face barriers related to user adherence. Mobile health (mHealth) apps offer promising tools to support health promotion and enhance autonomy in older adults.ObjectiveThis study aims to develop and validate a prototype mobile app, Mais Equilíbrio (More Balance), designed to guide older adults in performing home-based physical exercises adapted from the Otago protocol.MethodsThis methodological study was conducted in two phases: (1) content validation by 22 experts in physical education and physiotherapy using the Suitability Assessment of Materials (SAM) scale, and (2) usability testing with 24 older adults (aged 60 to 80 y), using the System Usability Scale (SUS). An overall score above 70% on the SAM and above 85 on the SUS were considered indicators of high quality and excellent usability, respectively.ResultsThe Mais Equilíbrio (More Balance) app was developed based on the Otago protocol and tailored for independent home use. A Content Validity Index above 0.95 was observed for all items. An overall average score of 81.20 (SD 15.78) on the SAM scale was found, classifying the material as “superior.” Usability tests with older adults showed an average score of 95.98 (SD 5.58) on the SUS, indicating excellent usability. The highest scores were observed in “ease of use” and “user confidence.”ConclusionsThe Mais Equilíbrio (More Balance) app, distinct for digitally adapting the Otago protocol to the Brazilian context and for its dual validation process with experts and older adults, has proven to be a valid and highly usable tool for guiding home-based physical exercise in older adults, with potential to promote fall prevention and autonomy.

Despite the high prevalence of cannabis consumption, there is limited information about cannabis based on scientific evidence available and targeted toward young adults, especially considering accessible language and ease of access. The present study aimed to develop the proof of concept of a chatbot for the dissemination of evidence and scientific information about cannabis, focused on a young adult audience. The proof of concept involved stages of literature review, conversation flow development, content evaluation through a panel of experts (n = 10) and usability analysis using a sample of potential users (young adults, n = 10). The chatbot developed presents information on epidemiology, toxicology, acute and chronic effects of cannabis use, information on cannabis use disorder, and the use of cannabinoids for medicinal purposes. The content evaluation through the Health Education Content Validation Instrument concluded that the tool was considered to have a good structure and content (Content Validity Index > 0,78; overall score = 9.0/10.0). The tool also proved to be functional and highly usable according to the analysis with the System Usability Scale (overall usability score = 9.2/10.0). Digital strategies such as chatbots can help in health education and scientific communication within stigmatized areas, such as the consumption of psychoactive substances.

Content validation is a critical phase in scale development. It provides the preliminary evidence on construct validity of an instrument. The content validation process followed in developing a scale designed to measure the student learning gains is explained in detail. Content validation involves two stages, identification of the content domain and item generation, and determining the content validity. A mixed deductive-inductive method was adopted for item generation. The content validity was assessed in two rounds, in the first round the Content Validity Ratio (CVR) was computed and the items with CVR critical value of 0.407 or above were accepted and subjected to computation of Content Validity Index (CVI) in the second round. Modified kappa values were determined to overcome the chance factor. The Item-Content Validity Index (I-CVI) values were computed to finalise the items in the final scale while the Scale-Content Validity Index (S-CVI) was determined to check for stability of each dimension as well as the scale as a whole. The CVI value above 0.78 was considered fit for the scale.

The importance of content validity in the instrument psychometric and its relevance with reliability, have made it an essential step in the instrument development. This article attempts to give an overview of the content validity process and to explain the complexity of this process by introducing an example. We carried out a methodological study conducted to examine the content validity of the patient-centered communication instrument through a two-step process (development and judgment). At the first step, domain determination, sampling (item generation) and instrument formation and at the second step, content validity ratio, content validity index and modified kappa statistic was performed. Suggestions of expert panel and item impact scores are used to examine the instrument face validity. From a set of 188 items, content validity process identified seven dimensions includes trust building (eight items), informational support (seven items), emotional support (five items), problem solving (seven items), patient activation (10 items), intimacy/friendship (six items) and spirituality strengthening (14 items). Content validity study revealed that this instrument enjoys an appropriate level of content validity. The overall content validity index of the instrument using universal agreement approach was low; however, it can be advocated with respect to the high number of content experts that makes consensus difficult and high value of the S-CVI with the average approach, which was equal to 0.93. This article illustrates acceptable quantities indices for content validity a new instrument and outlines them during design and psychometrics of patient-centered communication measuring instrument.

The System Usability Scale (SUS) score survey is a widely respected tool for measuring usability. While there are other surveys available such as the User Experience Questionnaire (UEQ) or the Single Ease Question (SEQ), the SUS is amongst the most popular and widely used instrument. SUS provides an easy-to-understand score with benchmarking. Generally, a SUS score is administered directly after a usability test to assess the user experience and the usability of a product, including websites and smartphone apps and more. However, some researchers have used it as a survey as part of a ‘in the wild’ trial which is often completed after the trial or indeed sometime after the subjects interacted with the technology. With this in mind the aim of this research was to see if a participant’s user experience would change if a SUS score was administered at different times after a test to understand if recalling the usability of technology led to temporal bias for the SUS.

This study focuses on developing and validating an instrument to measure the readiness for Internet of Things (IoT) integration in fire detection systems for residential housing types. The main objective is to develop a valid and reliable survey instrument to assess users’ readiness to accept and use IoT technology in the context of home fire safety. The research methodology involves a combination of the Technology Readiness Index (TRI) Theory and the Technology Acceptance Model (TAM) as the theoretical basis for the development of instrument items. This process was followed by content validation involving six expert panel members appointed in the field of fire safety. Survey questions were distributed to experts via email. These experts assessed the proposed items’ appropriateness, clarity, and relevance. The initial instrument consisted of 45 items covering the main dimensions of TRI (optimism, innovation, discomfort, insecurity), TAM constructs (perceived usefulness, perceived ease of use, and behavioral intention), and Readiness to use IoT for fire detection at home. The findings were analyzed using the Content Validity Ratio (CVR) and Content Validity Index (CVI) methods. Through the content validation process, 7 items were revised or filtered to produce a final instrument with 38 items. Findings show that the developed instrument has good content validity, with a satisfactory Content Validity Ratio (CVR) and Content Validity Index (CVI). Reliability analysis indicates high internal consistency across all dimensions of the instrument. This study contributes to the literature by providing a validated instrument to measure IoT integration readiness in residential fire detection systems. This instrument can be used by researchers, policymakers, and industry professionals to assess and predict IoT technology readiness in the context of home fire safety.