Website Evaluation Research Articles

Evaluating equity, diversity, and inclusion in Canadian Postgraduate Medical Education: A cross-sectional analysis of online content.

Medical graduates applying to Residency through the Canadian Resident Matching System (CaRMS) utilize the internet to gather information on programs and their overarching Postgraduate Medical Education (PGME) Office. This study aims to evaluate how PGME websites across Canada convey their commitment to equity, diversity, and inclusion (EDI) through their website features. Cross-sectional analysis of the 17 Canadian PGME websites against 20 EDI criteria based on contemporary literature, across five domains: leadership and governance, recruitment, accommodations, community engagement, and pathways to entry. Non-parametric testing was conducted to explore the relationship between EDI performance and municipal population diversity and geographic region. The evaluation of PGME websites, policies, reports, and plans revealed a mean score of 8.65/20 (SD = 3.00), with scores ranging from a minimum of 4/20 to a maximum of 13/20, indicating variability in EDI representation. Specifically, the domain of leadership and governance demonstrated the highest mean proportion of completed criteria (51%), while community engagement had the lowest (24%). Notably, 9 out of 17 PGME websites (53%) met at least 10 EDI criteria. Analysis by geographic region demonstrates significant mean differences (p = 0.02), with Ontario (10.50, SD = 2.17) and Western Provinces (11.00, SD = 0.00) scoring notably higher than Quebec (4.50, SD = 0.58), the Prairies (8.50, SD = 2.12), and the Atlantic region (8.00, SD = 2.83). The assessment of Canadian PGME websites reveals varying levels of commitment to EDI. While many programs exhibit strong EDI representation in mission statements, access to mental health services, and anti-discrimination policies, there are notable gaps in leadership messaging, diverse interview panels, family-friendly policies, and deliberate recruitment of underrepresented groups. Regional differences highlight the need for sharing best practices to promote inclusivity across the country. Improving EDI efforts on PGME websites can promote the recruitment and retention of a diverse resident population.

Evaluation of NCI-Designated Cancer Center and Comprehensive Cancer Center Survivorship-Focused Websites: Information Provided and Accessibility.

Individuals with a history of cancer increasingly seek health information from online resources, including NCI-designated Cancer Center websites. Centers receive NCI designation because they provide excellent care and engage in cutting-edge research. However, the information presented on these webpages and their accessibility is unknown. An evaluation of the survivorship-focused webpages from NCI-designated Cancer Centers is needed to assess survivorship information and accessibility of these webpages. We conducted an evaluation of the survivorship-focused webpages from 64 NCI-designated Cancer Centers. We evaluated where survivorship-focused webpages were housed, if there was a survivorship clinic or program, target audience of the webpage, how cancer survivor was defined, contact methods, and available resources. Accessibility outcomes included readability, font type, font size, color scheme, and alternative text (alt text) descriptors. An artificial intelligence (AI) audit was conducted to assess if the webpage was compliant with national accessibility guidelines. Most cancer centers had a survivorship-focused webpage, with 72% located on the cancer center's website and 28% on a health system website. Survivorship information available varied considerably and was often lacking in detail. Although three-quarters of webpages targeted patients only, variable definitions of cancer survivor were observed. Accessibility issues identified included inconsistent use of alt text descriptors, font size smaller than 15 points, and color schemes without adequate contrast. The average reading-level of information presented was above 12th grade. Only 9% of webpages were compliant with online accessibility guidelines; 72% semicompliant and 21% were noncompliant. Information presented on NCI-designated Cancer Center survivorship-focused webpages was inconsistent, often lacking, and inaccessible. NCI-designated Cancer Centers are role models for cancer research in the United States and have an obligation to provide survivorship information. Changes to content and website design are needed to provide better information for individuals seeking resources and health information relative to their cancer and care.

Digital health applications in urology

Digital health applications (DiGA) were included in the German healthcare system in 2020. They are available for prescription and reimbursed by public and private insurance companies. For the specialty of urology, there are currently two DiGA available: for the treatment of erectile dysfunction and benign prostatic hyperplasia/overactive bladder (BPH/OAB). The legal basis, clinical results and practical implementation are presented. Evaluation of websites and publications to show the regulatory requirements, mode of action, results of clinical trials and prescribing practice with DiGA. Since 2020, 63DiGA have been listed in the register of the Federal Office for Drugs and Medical Devices (BfArM), 35 of them definitively. Two urological DiGA aim to treat erectile dysfunction and BPH/OAB. Randomized, controlled studies have shown asignificant and clinically relevant patient benefit for both DiGA. Further urological DiGA are in clinical development. DiGAs offer multimodal therapy combinations that have not yet been used in clinical practice and show amultidimensional benefit for the patient.

Integrating Justice, Equity, Diversity, Inclusion & Indigeneity into an Informatics Curriculum.

In this case study, we present the inclusion of justice, equity, diversity, inclusion, and Indigeneity (JEDI-I) principles into a graduate certificate in clinical informatics. We specifically focus on two assignments that were created for the program: 1) journal club, 2) usability evaluation. We found that there was limited description of JEDI-I principles in journal club articles. New criteria for authentic resource evaluation were somewhat met in the usability evaluation of a sexual health website. Incorporating JEDI-I principles into the assignments supported fulsome conversations about end-user of technology in healthcare. Identifying examples of including JEDI-I would strengthen students' experiences in clinical informatics programs.

Evaluation and Decision-Making Optimization of Arctic Navigation Meteorological and Sea Ice Information Websites

Evaluation and Decision-Making Optimization of Arctic Navigation Meteorological and Sea Ice Information Websites

Library Website Evaluation: How Do Australian States Compare?

ABSTRACT Public library websites provide information about services, programs, and materials. Evaluating what each library website does well or poorly can be done through evaluating how each state compares to one another. This project is a longitudinal study which looks at three sets of data collected during different time periods (2013–14; 2017–18; 2021–22). Forty postgraduate students were used to collect the data through a project management course that involves Work Integrated Learning (WIL) components.

Evaluation and selection of E-learning websites using intuitionistic fuzzy confidence level based Dombi aggregation operators with unknown weight information

In recent years, the surge in online learning has eclipsed traditional classroom teaching, elevating the prominence of e-learning platforms. However, the quest for a reliable methodology to evaluate these platforms has remained pressing. While several studies have explored this domain, none have integrated decision experts’ confidence levels. This study bridges this gap by seamlessly incorporating confidence levels into Dombi aggregation operators within an intuitionistic fuzzy framework. The study introduces two innovative operators: the confidence-level intuitionistic fuzzy Dombi weighted averaging operator (CIFDWA) and the confidence-level intuitionistic fuzzy Dombi weighted geometric operator (CIFDWG). These operators are employed to form a novel multi-attribute group decision-making (MAGDM) approach, which is demonstrated by applying them to select the optimal e-learning website in a real-world scenario. The “Stepwise Weight Assessment Ratio Analysis (SWARA)” method is utilized to determine criteria weights. The findings highlight the critical importance of sub-criteria such as topic diversity, pricing, content credibility, data security, and user interface simplicity. The analysis reveals Unacademy as the leading platform, closely followed by Byju’s. Through meticulous comparative analysis and sensitivity evaluations, we underscore the stability and coherence of the proposed model. The study’s novelty lies in its innovative approach to integrating confidence levels in multi-attribute group decision-making scenarios, promising broader applications across various real-world contexts. Educational advisers and management can leverage this methodology to empower students with informed choices.

Evaluation of the Fetal Alcohol Spectrum Disorder Hub Australia website.

To evaluate use and utility of the Fetal Alcohol Spectrum Disorder (FASD) Hub Australia website. Online REDCap user survey incorporating the Website Evaluation Questionnaire, open ended questions, Google metrics data and an accessibility audit. Seventy-six participants: researchers (32%), health professionals (29%) and policymakers/advocates (16%) completed the survey. Most were from Australia (95%) and were likely or very likely to recommend the FASD Hub to colleagues (92%), friends (74%) and patients (72%). The mean Website Evaluation Questionnaire score was at least 3.45/5 for all dimensions (ease of use, hyperlinks, structure, relevance, comprehension, completeness, layout, search option); range 3.45 (search option) to 4.04 (relevance). Participants found the content trustworthy (92%) but wanted more information for, and to support, Aboriginal and Torres Strait Islander peoples, and improved search capacity. Google metrics identified 25,534 unique users over 6 months (82% new users); 83% aged 18-44 years, 72% female and 35% international. Users found the FASD Hub accessible, authoritative and useful and suggested improvements.

A Study on Digital Literacy Skills and Library Services Delivery in Tamil Nādu Universities - A Correlation

The Study is about to find a correlation between Digital Literacy skills and the Library Services Delivery in Tamil Nadu Universities and more than 75 library professionals of selected Tamil Nādu Universities through random sampling method are used for the study. A questioner in Google Form was designed and circulated among the 75 users through e-mail for data collection using random sampling method. Out of the 75 questioners circulated, only 63 are dully filled and found suitable for data analysis. Descriptive and inferential statistics was used for analysis of Data and Single hypothesis with 0.05 level of significance using the linear regression was tested. Subsequently, Creswell correlational ranking was used to decide the strength of relationship strength between variables and results are displayed in frequency tables. The findings of the study show that majority of library professionals have Digital Literacy skill, a considerable number of Library Professionals have to improve their digital literacy skill in areas like ability to use computer systems for information dissemination, ability to use different software, design a simple webpage, obtain product keys for software, design Mobile Applications, and design Cloud Applications etc. Among other skills and among the numerous services provided by the library, the library professionals were skillful in using internet to search and communicate information, conduct website evaluation and use Boolean logic etc. Moreover, Study results showed a correlational value of 0.963 and the hypothesis yielded a p-value less than 0.05. Which implies that the null Hypothesis is rejected, and it is concluded that there is evidence of linear relationship and hence there is significant relationship between the Digital Literacy Skills of the Library professionals and the Library Service Delivery of the Identified universities in Tamil Nādu. Based on the results of the study it is recommended that library authorities should focus on the ways and means of, intensifying the efforts in creating awareness and should be initiated steps that the library professionals should be provided with appropriate training on digital literacy skills, their application and essence, in order to enable them to acquire more of the skills, together with applying them to maximize the library service delivery, among other things for better service to the users.

Usability evaluation of the educational website "understanding my diabetes" for Mexican patients with type 2 diabetes.

Diabetes education is an integral part of the treatment for the metabolic control of patients with diabetes. The use of the Internet as a tool for diabetes education, as well as its acceptance, is still under study. To assess the usability of the educational website "I understand my diabetes" designed for patients with type 2 diabetes attending primary care clinics. A cross-sectional study was done in 110 patients with type 2 diabetes from two family medicine clinics, each of whom was assigned a user account on the educational website "Entiendo mi diabetes." The web site assigned a user name and password to each patient. They were able to access the educational website at home. After a 15-day review period, participants were asked to evaluate usability using the Computer System Usability Questionnaire. Additionally, we developed an eight-item questionnaire usability focusing on diabetes care. Sociodemographic data, blood pressure, and anthropometric measurements were recorded. Glucose levels and lipid profiles were also measured. The patients with diabetes had a mean age of 52.7 years and a median of 5 years since they were diagnosed with diabetes. The website received a good usability rating from 89.1% of participants, with favorable assessments in all three dimensions: 87.3% for information, 85.5% for quality, and 88.2% for interface. Regarding usability specifically for diabetes care, 98.2% rated it as having good usability. The website for education about the disease in patients "I understand my diabetes" had an adequate usability evaluation by patients, so they also considered it very useful for diabetes care. The diabetes care instrument had adequate usability and reliability.

An Evaluation of Hospice and Palliative Medicine Fellowship Websites

An Evaluation of Hospice and Palliative Medicine Fellowship Websites

Assessment of Greek Hospital Websites using HSWAI v1.1

In modern times, technology is the driving force behind all human activity. The Internet is an integral part of peo- ple's lives and the majority of daily activities are carried out through it. The health sector is no exception as new concepts such as e-health, mobile health etc. have been introduced. Patients and potential users of health services use the websites of healthcare institutions to find and access information about their health problems in health services. The present research carried out as part of a diploma the- sis for the Information and Communication Systems Engi- neering Department of the "Electronic Governance" Master's Program of the Aegean University, attempts to investigate the quality and completeness of the websites of Greek nurs- ing institutions. The object of the research is the evaluation of hospital websites using the HSWAI evaluation tool. It is an excel file containing four(4) criteria with sixteen(16) indica- tors and one hundred sixty-eight(168) sub-indicators. Each sub-indicator includes a presumption that is examined to see if it is met by the nursing website under investigation. In the end a score is produced that identifies the hospital website according to the iHSWAI index global ranking. This fact helps the users and potential customers of health services to com- pare and choose the provider that satisfies them while at the same time it helps the administrations of the institutions to improve and enrich their hospital websites. The research sample consists of public and private nursing institutions operating in the Greek territory. One hundred and twenty-three(123) public hospitals and one hundred and twenty-two(122) private hospitals were evaluated, while sixty-four(64) institutions were not evaluated due to a lack of a website or technical difficulties. The results of the survey revealed that public hospitals have more complete websites as they performed better in the HSWAI score than the private ones. Also, the comparisons made in the context of the research results showed that the more beds a hospital manages, the better quality and more complete website it has. Also, the quality of hospital websites depends on the geographic area where the hospitals are located and the Health District they belong to.

The Application of K-means Clustering Algorithm in the Evaluation of E-Commerce Websites

When dealing with large amounts of high-dimensional transaction data, clustering approaches often struggle with challenges including elasticity, weak processing capabilities of high-dimensional data, sensitivity to data sequence across time, independence of parameters, and ability to manage noise. These problems may prevent the methods from providing accurate predictions. Experiments conducted with data samples collected from 300 different mobile phones purchased on Taobao yielded the following results. K-means beats Single-pass in evaluating e-commerce transactions because of its higher intra-class dissimilarity and inter-class similarity. K-means clustering is an approach to the organization of massive datasets that is both effective and flexible. The outcome of the clustering algorithm is sensitive not only to the total number of clusters but also to how they were initially arranged. Because of this, it is simple to demonstrate that the results of clustering are best optimized locally. For this reason, continuing research into the elements that influence the number of clusters produced by this method as well as the starting locations of the clustering center is a crucial endeavor.

Development and Evaluation of a Clinician-Vetted Dementia Caregiver Resources Website: Mixed Methods Approach.

About 11 million Americans are caregivers for the 6.7 million Americans currently living with dementia. They provide over 18 billion hours of unpaid care per year, yet most have no formal dementia education or support. It is extremely difficult for clinicians to keep up with the demand for caregiver education, especially as dementia is neurodegenerative in nature, requiring different information at different stages of the disease process. In this digital age, caregivers often seek dementia information on the internet, but clinicians lack a single, reliable compendium of expert-approved digital resources to provide to dementia caregivers. Our aim was to create a dementia caregiver resources website to serve as a hub for user-friendly, high-quality, and expert-reviewed dementia educational resources that clinicians can easily supply to family caregivers of people with dementia. An interdisciplinary website development team (representing dementia experts from occupational therapy, nursing, social work, geriatrics, and neurology) went through 6 iterative steps of website development to ensure resource selection quality and eligibility rigor. Steps included (1) resource collection, (2) creation of eligibility criteria, (3) resource organization by topic, (4) additional content identification, (5) finalize resource selection, and (6) website testing and launch. Website visits were tracked, and a 20-item survey about website usability and utility was sent to Veterans Affairs tele-geriatrics interdisciplinary specialty care groups. Following website development, the dementia caregiver resource website was launched in February 2022. Over the first 9 months, the site averaged 1100 visits per month. The 3 subcategories with the highest number of visits were "general dementia information," "activities of daily living," and "self-care and support." Most (44/45, 98%) respondents agreed or strongly agreed that the website was easy to navigate, and all respondents agreed or strongly agreed that the resources were useful. The iterative process of creating the dementia caregiver resources website included continuous identification, categorization, and prioritization of resources, followed by clinician feedback on website usability, accessibility, and suggestions for improvement. The website received thousands of visits and positive clinician reviews in its first 9 months. Results demonstrate that an expert-vetted, nationally, and remotely available resource website allows for easy access to dementia education for clinicians to provide for their patients and caregivers. This process of website development can serve as a model for other clinical subspecialty groups seeking to create a comprehensive educational resource for populations who lack easy access to specialty care.

Impact of user evaluations of website attributes on recommendation intention for revitalizing B2B textile platform

Impact of user evaluations of website attributes on recommendation intention for revitalizing B2B textile platform

Usability Evaluation of Medical Tourism Websites in Iran

Introduction: Medical tourism is a recent form of travel that involves rapidly increasing overseas trips to address a variety of health issues. Medical tourism websites play a vital role in offering information and resources for people looking for medical treatment overseas. A well-designed and easy-to-use website can help build trust and credibility with potential patients. The aim of this study is to assess the usability of the leading medical tourism websites in Iran.Material and Methods: The present study was a descriptive and cross-sectional study. In this study, the usability of five top medical tourism website in Iran were evaluated using heuristic evaluation method. The checklist was based on Nielsen’s heuristics. The criteria for selecting the top websites were Alexa Rank Checker.Results: The median of usability problems rates in website1, website2, website3, website4, and website5 were 11.1%, 7.7%, 9.9%, 10% and 9.1%, respectively. The median severity of identified problems for website1, website2, website3, website4, and website5 were 2.6%, 2.9%, 2.9%, 2.9% and 2.8%, respectively. The principles of “help and documentation”, “visibility of site status”, and “Security and privacy” in the five websites were categorized into the “highest rate of problems”, “lowest rate of problems”, and “highest severity of problems” groups, respectively.Conclusion: By addressing usability issues of medical tourism websites, organizations can better serve their users and ultimately contribute to the growth of the medical tourism industry.

Readability and credibility evaluation of most-visited health websites based on eBizMBA and Alexa global ranking

Introduction: Online health information is one of the most important and widely used sources of information. Currently, a significant number of individuals use the internet for health-related information to learn about health, disease, health promotion, and threats to their health.Material and Methods: This research examined the top 15 health websites based on their popularity in eBizMBA and Alexa rank from January to February 2022. A total of 30 health websites (15 from each category) were evaluated in terms of credibility by the use of Journal of the American Medical Association (JAMA) and health on the net foundation (HON) code. Also, the readability of the mentioned websites was evaluated by the use of four readability tools.Results: Most of the websites ranked by both Alexa and eBizMBA met the “Authority” and” Complementarity" criteria. When it comes to the readability of the 30 most visited health websites according to eBizMBA and Alexa analytics in the world, the analysis demonstrated that the readability of highly-ranked health websites was higher than the recommended level.Conclusion: Some of the websites had deficiencies according to the HONcode and JAMA criteria, and the average readability of the websites did not meet the gold standard. Despite the increasing use of the internet for medical information, these resources' poor quality and readability remain a barrier to informed decision-making of patients.

Evaluating the Technical Quality and Pedagogical Affordances of an English Language Learning (ELL) Website Using a Methodological Framework

Websites are commonly regarded as valuable educational resources that extend beyond the confines of the traditional classroom setting. The primary challenge lies in the identification of reputable online sources. The aforementioned concept underscores the imperative necessity of conducting website evaluations. The use of methodological frameworks as an evaluative instrument can effectively examine the potential of a website within a specific context, as frameworks possess descriptive qualities. Despite the extensive body of studies done concerning website evaluation, there are still a significant number of unresolved issues. Therefore, in order to address these significant deficiencies, this qualitative study aims to evaluate the efficacy of an English Language Learning (ELL) website by examining its technical and pedagogical dimensions. The LearnEnglish Kids website was chosen due to its adherence to all of the screening criteria. The evaluation process was conducted in accordance with the methodological framework. Despite the limitations identified, the LearnEnglish Kids proves to be a suitable English Language Learning (ELL) website for integration within the Malaysian educational context. The examination of the six evaluation aspects provides a comprehensive guide for the Ministry of Education in the development of open educational resources (OER) for primary school students in Malaysia.

Evaluation of consumer-oriented websites for menopause education

The author reports the findings of a study utilizing a systematic approach to review consumer-oriented websites on menopause to determine which are accurate and accessible and give nurse practitioners these resources to recommend to patients seeking more menopause information.

Quality of Patient-Centered eHealth Information on Erosive Tooth Wear: Systematic Search and Evaluation of Websites and YouTube Videos.

Due to the declining prevalence of dental caries, noncarious tooth defects such as erosive tooth wear have gained increased attention over the past decades. While patients more frequently search the internet for health-related information, the quality of patient-centered, web-based health information on erosive tooth wear is currently unknown. This study aimed to assess the quality of patient-centered, web-based health information (websites and YouTube videos) on erosive tooth wear. German-language websites were systematically identified through 3 electronic search engines (google.de, bing.de or yahoo.de, and duckduckgo.com) in September 2021. Eligible websites were independently assessed for (1) technical and functional aspects via the LIDA instrument, (2) readability via the Flesch reading-ease score, (3) comprehensiveness of information via a structured checklist, and (4) generic quality and risk of bias via the DISCERN instrument by 2 different reviewers. An overall quality score (ie, higher scores being favored) generated from all 4 domains was used as the primary outcome. Quality scores from each domain were separately analyzed as secondary outcomes and compared by the Friedman test. The effect of practice-specific variables on quality scores of websites from private dental offices was assessed using generalized linear modeling. Eligible YouTube videos were judged based on (1) the comprehensiveness of information, (2) viewers' interaction, and (3) viewing rate. The comprehensiveness of information was compared between websites and YouTube videos using the Wilcoxon rank-sum test. Overall, 231 eligible websites and 7 YouTube videos were identified and assessed. The median overall quality of the websites was 33.6% (IQR 29.8%-39.2%). Secondary outcome scores amounted to 64.3% (IQR 59.8%-69.0%) for technical and functional aspects, 40.0% (IQR 34.0%-49.0%) for readability, 11.5% (IQR 3.9%-26.9%) for comprehensiveness of information, and 16.7% (IQR 8.3%-23.3%) for generic quality. While the comprehensiveness of information and generic quality received low scores, technical and functional aspects as well as readability resulted in higher scores (both Padjusted<.001). Regarding practice-specific variables, websites from private dental offices outside Germany (P=.04; B=-6.64, 95% CI -12.85 to -0.42) or from dentists who are a dental society member (P=.049; B=-3.55, 95% CI -7.09 to -0.01) resulted in lower readability scores (ie, were more difficult to read), while a shorter time since dentists' examination resulted in higher readability scores (P=.01; B=0.24 per year, 95% CI 0.05-0.43). The comprehensiveness of information from YouTube videos was 34.6% (IQR 13.5%-38.5%). However, the comprehensiveness of information did not vary between websites and YouTube videos (P=.09). Additionally, viewers' interaction (1.7%, IQR 0.7%-3.4%) and viewing rates (101%, IQR 54.6%-112.6%) were low. The quality of German-language, patient-centered, web-based information on erosive tooth wear was limited. Especially, the comprehensiveness and trustworthiness of the available information were insufficient. Web-based information on erosive tooth wear requires improvement to inform patients comprehensively and reliably.