Website Evaluation Research Articles

Quality and content evaluation of websites with information about immune checkpoint inhibitors: An environmental scan.

BackgroundTrustworthy educational information for patients is critical for increasing their knowledge base and preparing them for shared decision making with clinicians. As the internet has become an important source of health information for many patients, the purpose of this study was to assess the quality and content of websites with educational content about immune checkpoint inhibitors.MethodsWe performed an environmental scan of the currently available websites providing educational information for patients about immune checkpoint inhibitors. We used three search engines: Google, Bing, and Yahoo! (9/20/2021). Two independent investigators selected relevant uniform resource locators (URLs), appraised the quality of the websites, and collected their characteristics. We evaluated the accuracy, completeness, technical elements, design and aesthetics, readability, usability, and accessibility of the websites. The user experience was also evaluated.ResultsWe identified 37 websites for analysis. In 10 websites (27%), it was not possible to know the source of the information provided. Thirty-three (89%) provided a definition with a simple explanation of cancer and treatment and 30 (81%) on complications of immune checkpoint inhibitors; only seven (19%) provided information about the balance between risks and benefits. Thirty-five (95%) provided a statement of purpose. Regarding the design, all 37 (100%) had appropriate visual aspects, typography, and grammar. Thirty-six (97%) were well organized. For most of the websites (n = 35, 95%) the content was easy to find. Only two websites had a readability score of 6, while the others had higher scores. Regarding the user experience, the overall quality of websites was rated as excellent in 16 (43%), good in 14 (38%), and fair in 7 (19%).ConclusionsOur findings reveal that websites with information about immune checkpoint inhibitors mostly have general information about cancer, the treatments, and adverse events. Few websites provide information about the balance between harms and benefits of treatment, costs, the source of the information, or the hierarchy of evidence. These findings identify the gap in the quality and content of websites for patients treated with immune checkpoint inhibitors and can help website creators and developers.

Interactivity, Quality, and Content of Websites Promoting Health Behaviors During Infancy: 6-Year Update of the Systematic Assessment.

BackgroundAs of 2021, 89% of the Australian population are active internet users. Although the internet is widely used, there are concerns about the quality, accuracy, and credibility of health-related websites. A 2015 systematic assessment of infant feeding websites and apps available in Australia found that 61% of websites were of poor quality and readability, with minimal coverage of infant feeding topics and lack of author credibility.ObjectiveWe aimed to systematically assess the quality, interactivity, readability, and comprehensibility of information targeting infant health behaviors on websites globally and provide an update of the 2015 systematic assessment.MethodsKeywords related to infant milk feeding behaviors, solid feeding behaviors, active play, screen time, and sleep were used to identify websites targeting infant health behaviors on the Google search engine on Safari. The websites were assessed by a subset of the authors using predetermined criteria between July 2021 and February 2022 and assessed for information content based on the Australian Infant Feeding Guidelines and National Physical Activity Recommendations. The Suitability Assessment of Materials, Quality Component Scoring System, the Health-Related Website Evaluation Form, and the adherence to the Health on the Net code were used to evaluate the suitability and quality of information. Readability was assessed using 3 web-based readability tools.ResultsOf the 450 websites screened, 66 were included based on the selection criteria and evaluated. Overall, the quality of websites was mostly adequate. Media-related sources, nongovernmental organizations, hospitals, and privately owned websites had the highest median quality scores, whereas university websites received the lowest median score (35%). The information covered within the websites was predominantly poor: 91% (60/66) of the websites received an overall score of ≤74% (mean 53%, SD 18%). The suitability of health information was mostly rated adequate for literacy demand, layout, and learning and motivation of readers. The median readability score for the websites was grade 8.5, which is higher than the government recommendations (<grade 8). Overall, 74% (49/66) of the websites obtained a poor rating for interactivity, measuring active control, 2-way communication, and synchronicity. The most common features found on websites were social media links (61/66, 92%), frequently asked questions (48/66, 73%), and videos (44/66, 67%). Only 14% (9/66) of websites presented culturally responsive information.ConclusionsQuality, content, readability, and interactivity of websites promoting health behaviors during infancy ranged between poor and adequate. Since the 2015 systematic assessment, there was a slight improvement in the quality of websites but no difference in the Suitability Assessment of Materials rating and readability of information. There is a need for researchers and health care providers to leverage innovative web-based platforms to provide culturally competent evidence-based information based on government guidelines that are accessible to those with limited English proficiency.

Accessibility evaluation of Arabic University websites for compliance with success criteria of WCAG 1.0 and WCAG 2.0

Accessibility evaluation of Arabic University websites for compliance with success criteria of WCAG 1.0 and WCAG 2.0

Minimally Invasive Surgery (MIS) fellowship website content: are applicants receiving enough information?

Advanced GI/Minimally Invasive Surgery (MIS) fellowships are one of the largest non-ACGME post-residency training pathways. MIS programs are highly competitive, with only 68% of applicants in the 2021 cycle successfully matching into fellowship positions. An evaluation of MIS fellowship program websites is warranted to determine if applicants are receiving adequate information to meet their needs. Using the Fellowship Council website, the authors identified 92 MIS fellowship programs that advertised open fellowships positions for general surgery residency graduates. These 92 fellowship websites were evaluated for 12 pre-identified variables based on published literature. 90% of websites included access to contact information for a program director/coordinator and 72% of websites displayed selection criteria; however, other recruitment information offered to applicants was limited. Only 25% of websites mentioned interview details, 34% of websites showcased current or past fellows, and 51% included a faculty directory. Regarding operative information, only 46% of MIS fellowship websites mentioned case volume, 23% mentioned locations of rotations, and 55% mentioned rotation schedule selection criteria. Didactic information was focused on research productivity with 80% of websites highlighting scholarly requirements; academic conferences were only mentioned in 40% of websites. Fellow wellness and career information was skipped on many websites, with 30% describing resident benefits and 16% dedicating a section to career development. Overall, the mean number of pre-identified variables present on a fellowship website was 6.57 ± 2.39 (54.75 ± 19.17%). General surgery residents turn to program websites when evaluating MIS fellowships. Although websites contain adequate information on several variables evaluated in the study, information on benefits and career development, fellow and faculty support, and case volume were limited. By including relevant information, MIS fellowship websites can align with ACGME requirements, strengthen existing frameworks, and help display data that are important to applicants.

Implementation and evaluation of the school's COVID-19 prevention website

PurposeThe purpose of this study is to investigate the effects of the Perceptions of coronavirus 2019 (COVID-19) questionnaire and the Information System Success Questionnaire on students when using the school's COVID-19 epidemic prevention website. The study is aimed toward analyzing both questionnaires as well as evaluating an epidemic prevention website.Design/methodology/approachThe school's COVID-19 prevention website and two questionnaires (Perceptions of COVID-19 and the Information System Success Questionnaire) are examined in order to investigate 73 students' COVID-19 perceptions. An open-ended question was used as the qualitative data to support quantitative data and evaluate a university's COVID-19 epidemic prevention website from a southern university in Taiwan.FindingsThe findings indicated that most students evaluated the school's COVID-19 website positively and were satisfied. In the open-ended questions, the majority of students rated the quality of the system positively and the need to fix some defects. Students have different COVID-19 perceptions and social distance compliance based on their current situations.Practical implicationsThis study provides researchers and website developers a broader understanding of the construction of the school's COVID-19 prevention website and a better understanding of student's COVID-19 perceptions.Originality/valueTo the best of the authors' knowledge, this is the first study examining a school's epidemic prevention website, which is measured by the Information Success Questionnaire and the Perceptions of COVID-19 Questionnaire for college students.

Pelatihan Dan Pendampingan Evaluasi Website Menggunakan Sortsite 5.3.5 Pada Website “Mal Pelayanan Publik” Dinas Penanaman Modal Dan Pelayanan Terpadu Satu Pintu Kota Samarinda

The use of the website as a means to bring public services closer to the community is indeed a must for the government in the digital era. The website plays an important role as a medium for the government to disseminate public information. Therefore, government websites that are built and funded through public funds must be able to reach all levels of society and have good performance. Based on that, this Community Service Program seeks to make a small contribution to the Samarinda City Government, especially the Samarinda City DPMPTSP related to training and assistance in evaluating the Public Service Mall website using SortSite 5.3.5. The implementation of the Community Service Program starts from the stages of problem identification, verification, provision of materials, implementation of training and mentoring and evaluation of activities. Based on the observation, it can be said that the training and mentoring program has successfully increase the skill and knowledge of DPMPTSP website operator.&#x0D; &#x0D; Keywords: Training, Mentoring, Website Evaluation, Samarinda City DPMPTS

Can Medical Students Evaluate Medical Websites?: A mixed-methods study from Oman.

ObjectivesThis study aimed to discover the extent to which medical students can evaluate medical websites, evaluation criteria used, factors affecting their abilities and whether a teaching intervention could rectify problems. Medical students and practitioners are required to evaluate medical information available on the Internet. Most current medical students are familiar with the Internet, but their ability to evaluate material may require improvement.MethodsA class of undergraduate medical students evaluated an unreliable medical website, received a teaching intervention on website evaluation criteria and re-evaluated the same site. This mixed-methods study was conducted at Sultan Qaboos University, Muscat, Oman, from September to December 2018.ResultsA total of 149 (response rate: 82.3%) students participated. Students spent, on average, 4.69 hours per day on the Internet. No significant correlations were found between demographic indicators and Internet time. On a 10-point Likert scale, students’ scores ranged from 5–6, with no significant differences between the pre- and post-intervention evaluations, except for increased polarisation away from the mean. Qualitative comments indicated an awareness of relevant criteria but an overall inability to critically apply them.ConclusionThe results indicate that one cannot make a blanket statement about medical students’ ability to evaluate medical websites despite their familiarity with technology. Moreover, website evaluation should be viewed primarily from the information perspective and that critical thinking ability may play a major role. Due to these overriding factors, short interventions are unlikely to have an impact, and other educational strategies should be developed. These are necessary to ensure that medical students can function independently as life-long learners and medical professionals.

Developing and evaluating an educational web-based tool for health professions education: the Flipped Classroom Navigator

BackgroundFlipped classroom pedagogy is a blended learning approach applied in undergraduate health professions education. However, teachers and students may require training to effectively engage in flipped classroom pedagogy. Thus, this study aimed to design, develop, and evaluate a web-based tool for fostering flipped classroom pedagogy in undergraduate health professions education.MethodsThis is an educational design-based research with a descriptive evaluation component which was conducted in two steps: (i) design & development and (ii) evaluation of an educational website. An expert panel was formed to evaluate the website by using a website evaluation questionnaire (WEQ). Descriptive statistics were employed to calculate the experts’ agreement level.ResultsAn innovative website design was used to provide access to a range of digital devices. The development process occurred concurrently in two steps: (i) website development and (ii) learning content development. The educational website was branded as the Flipped Classroom Navigator (FCN). Based on WEQ scores, the FCN obtained a good level of agreement (≥ 80%) for its’ ease of use, hyperlinks, structure, relevance, comprehension, completeness, and layout.ConclusionsThe FCN is an effective method for providing training to promote flipped classroom pedagogy in health professions education. The FCN achieved good evaluation scores and comments from experts. However, it is also necessary to obtain acceptance from the end-users, which could be the focus of future research. Nonetheless, the expert panel pinpointed areas for further development before introducing the FCN to end-users.

Key Shared Successes and Obstacles in the Use of E-banking in Developing Countries: A Case Study of the Bank of Tanzania Website Evaluation

Key Shared Successes and Obstacles in the Use of E-banking in Developing Countries: A Case Study of the Bank of Tanzania Website Evaluation

Accessibility and usability evaluation of university websites in Afghanistan: a comparison between public and private universities

Accessibility and usability evaluation of university websites in Afghanistan: a comparison between public and private universities

Age and neurocognition are associated with credibility evaluations of health websites

The internet has become a common means by which many older adults seek out health information. The prevalence of misinformation on the internet makes the search for accurate online health information a more complex and evaluative process. This study examined the role of age and neurocognition in credibility evaluations of credible and non-credible health websites. Forty-one older adults and fifty younger adults completed a structured credibility rating task in which they evaluated a series of webpages displaying health information about migraine treatments. Participants also completed measures of neurocognition, internet use, and health literacy. Results suggested that older adults rated non-credible health websites as more credible than younger adults, but the age groups did not differ in their ratings of credible sites. Within the full sample, neurocognition was associated with credibility ratings for non-credible health websites, whereas health literacy was related to the ratings of credible sites. Findings indicate that older adults may be more likely to trust non-credible health websites than younger adults, which may be related to differences in higher-order neurocognitive functions. Future work might examine whether cognitive-based supports for credibility training in older adults can be used to improve the accuracy with which they evaluate online health information.

Quality of Online Information for Esophageal Cancer.

The Internet is a readily available source of information, and patients in North America frequently access it. Esophageal cancer is the 7th most common cancer worldwide, but there is a lack of studies examining esophageal cancer website quality. This current study looks to systematically analyze the quality of websites accessed by patients with esophageal cancer. A previously validated website evaluation tool was used to analyze the quality of online esophageal cancer resources for patients. The term "esophagus cancer" was used to retrieve hits from the search engine Google and the meta-search engines Dogpile and Yippy. A 100 website list was compiled using pre-specified inclusion and exclusion criteria. Websites were evaluated regarding administration, accountability, authorship, organization, readability, content, and accuracy. The term "esophagus cancer" returned over 500 websites from the search engines. Of the 100 websites included for analysis, 97% disclosed ownership, sponsorship, and advertising. Only 35% identified an author and even fewer (31%) gave the author's credentials. Only 31% declared updates to their information within the past 2years. Readability scores revealed only 9%, and 12% of sites scored at an elementary level, according to the Flesch-Kincaid (FK) and SMOG scoring scales, respectively. The average FK and SMOG scores were 12.6 and 11.0, respectively. Detection was the most accurately described (70%). However, few websites provided accurate incidence/prevalence (28%), stage-specific prognosis (27%), or preventative information (17%). The quality of websites offering information on esophageal cancer is variable. While they overwhelmingly disclose website ownership interests, most do not identify authors, poorly describe important domains of esophageal cancer, and overall readability exceeds the commonly accepted level for non-healthcare professionals.

Usability and accessibility-based quality evaluation of Indian airline websites: An MCDM approach.

A tourist may be one of the most diverse kinds of consumer, including many people with disabilities. As a technologically driven industry, the tourism industry focused more on providing online services during the COVID-19 pandemic, where physical activity is limited and people practice social distancing. A company’s success may be large extend depend on the quality of the website through which they supply their services. The primary goal of the study presented in this paper is to evaluate the overall quality of Indian commercial airline websites. This study evaluated the seven websites of passenger airlines on usability and accessibility parameters using an online diagnostic tool. Page size, load time, response time, broken links, contrast errors were used as the usability parameters, and the TAW tool was used to evaluate the websites’ compliance with WCAG 2.0. The paper proposes a system for determining the best website by utilizing the Technique for Order of Preference by Similarity to Ideal Solution (TOPSIS), The Analytic Hierarchy Process (AHP), and the Fuzzy AHP methods. The result shows that Indian airline websites have many usability issues, and none of the websites adheres to WCAG 2.0 accessibility guidelines. Friedman’s test is applied to compare the ranking given by various MCDM techniques, resulting in no significant difference in the various ranking methods adopted.

Impact of website visual design on user experience and website evaluation: the sequential mediating roles of usability and pleasure

ABSTRACT In this study, we investigate how website visual design affects users’ experience, then their subsequent attitudinal and behavioural outcomes towards the website. We investigate the roles of usability and pleasure, two important constructs of user experience, and propose a three-path sequential mediation model. We test the model with experiments in which we assign web users with varied levels of website visual design in two studies, one with a fictional website and the other with comparable webpages from real e-commerce websites. In both experiments, we find a consistent positive effect of website visual design on website evaluation variables through a sequential mediation of usability and pleasure. An alternative reversed mediation model in which pleasure precedes usability is also tested but found to be unsupported.

Service Performance Evaluation of ITS Library Institution Repository Website

The ITS library as a unit that supports the ITS industrial revolution 4.0 strategy must make improvements to the application of information technology services to users. The ITS library repository website as a portal for storing scientific works of the ITS academic community is one of the information technology services that is often used by the ITS academic community (siva), but there has been no development for more than 5 years. For this reason, it is necessary to research evaluating the service quality of the ITS library repository website using webqual 4.0, which includes 3 (three) dimensions, namely: usability, information quality, and service interaction quality. The method used is a survey of distributing questionnaires to ITS final semester students who use the repository's independent upload service. As many as 100 students use the repository's independent upload service, then an IPA analysis (importance performance analysis) is carried out to determine the level of user satisfaction. The measurement results of the evaluation of the ITS Library repository website show a gap of -0.7, meaning that user satisfaction with the ITS Library repository website has not yet been achieved, while the IPA matrix diagram shows 2 (two) service indicators that are prioritized for quality improvement, namely interaction with the ITS repository website, which is safe from viruses and hackers when accessed via a PC or smartphone, and a quick search menu (title, author, supervisor, department) that gives inaccurate search results.

User Experience Evaluation of B2C E-Commerce Websites Based on Fuzzy Information

With the popularization of personal computers and the development of the Internet, the number of netizens is increasing. The emerging B2C e-commerce platform shows the fierce competition in the e-commerce market. B2C e-commerce distribution is faced with the problems of high distribution cost, long time, and poor quality, which leads to the poor user experience of B2C online shopping and the lack of trust in e-commerce enterprises. This research mainly discusses the user experience evaluation of B2C e-commerce websites based on fuzzy information. First, the AHP analytic hierarchy process is used to construct a hierarchical evaluation system, and then, the two-by-two judgment matrix is compared to the index factors at all levels, and experts are invited to score the method to determine the weight of each index to test whether it meets the consistency requirements. Finally, the fuzzy comprehensive evaluation method is used to perform fuzzy conversion of the original weight, and the membership degree set of the user experience evaluation factors is given, and the fuzzy comprehensive calculation result of the B2C website performance level is calculated. By combining in-depth interviews with website users and questionnaire surveys to analyze the behavioral characteristics of user information navigation, summarize the demand list for product search, product selection, product comparison, and product detail page browsing, and provide a reference for the design and development of information navigation. Calculating the decision model, mainly using fuzzy calculation, calculate the foreground value under each attribute and get the comprehensive foreground value. By comparing with the decision-making behavior model constructed by expected utility theory, it is found that the behavioral decision-making model constructed in this paper based on prospect theory can be closer to the actual situation. In this study, the satisfaction with the function provided reached 68 points, the emotional response 66 points, the aesthetic response 70 points, and the information construction 64 points. Through empirical research, the key factors affecting user satisfaction of B2C e-commerce logistics distribution are summarized, and a B2C e-commerce logistics distribution evaluation system based on user experience is established. This research will provide methods and ideas for the research on user experience design of e-commerce websites and the research and development of related network products. The article helps to draw out the countermeasures and suggestions for the development of the current B2C e-commerce logistics distribution.

Accessibility evaluation of university hospital websites in Turkey.

Hospital web pages serve as an interactive communication resource to meet the needs of patients, healthcare professionals and other stakeholders. The aim of this study is to present the accessibility analysis of 58 university hospital websites in Turkey. For this purpose, websites of the selected university hospitals were analyzed using two different online automated testing tools. The results showed that university hospital websites in Turkey had low compliance levels according to the WCAG 2.0 guidelines. Most of the websites did not even meet the minimum requirements for compliance level A. In addition, almost all of the websites had broken links and about a third of the websites had problems with accessing from mobile devices. Moreover, some important clues that draw attention to the accessibility problems of websites are also discussed in this study. Hence, the results of this study provide feedback to developers and administrators to improve the accessibility of these websites.

Evaluating e-commerce website qualities: personality traits as triggers

PurposeThe five-factor model (FFM), a popular personality typology that identifies five key personality traits, has been used to predict use intention in various e-commerce applications, but the role of FFM in triggering certain evaluations of the various quality dimensions of e-commerce websites has not been examined, revealing a gap, i.e. the authors do not know how the five personality traits impact evaluations of the quality dimensions of e-commerce websites. The 3Q model—which comprises system quality (SysQ), information quality (IQ), and service quality (SQ), spanning 13 quality dimensions—is helpful for evaluating website quality, but the model neglects user characteristics and their impacts on quality evaluation, posing another gap, i.e. the authors do not know how user characteristics impact the user's evaluation of quality dimensions. Thus, the authors used the FFM to extend the 3Q model to explain how user personality predicts the evaluation of websites in the 13 quality dimensions.Design/methodology/approachThe authors used an online survey to collect responses from 392 online shoppers. Structural equation modeling was used to test the hypotheses.FindingsThe authors found that openness in a shopper predicts their favorable evaluation of a website in the quality dimensions of format and flexibility; conscientiousness predicts favorable evaluation in terms of completeness, accuracy, currency, timeliness, and service reliability; neuroticism predicts unfavorable evaluation in terms of reliability, accessibility, and assurance; and extraversion predicts favorable evaluation in terms of responsiveness; while agreeableness did not predict empathy.Originality/valueIn sum, the authors successfully used the FFM to theoretically extend the 3Q model, which clarifies the usefulness and pathways of personality in formulating strategies for e-commerce success.

Website analytics for government user behavior during COVID-19 pandemic

PurposeThe present study aims to clarify the following two research objectives: (1) the user behavior of government websites during the coronavirus disease (COVID-19) period and (2) how the government improved government's website design during the COVID-19 period.Design/methodology/approachThe authors used website analytics to examine usage patterns and behaviors of the government website via personal computer (PC) and mobile devices during the COVID-19 pandemic. In-depth interviews were conducted to understand the user experience of government website users and to gather users' opinions about how government websites should be redesigned.FindingsWith the rising of the COIVID-19 pandemic, most studies expect that the use of government websites through a mobile device will grow astonishingly. The authors uncovered that the COVID-19 pandemic did not increase the use of government websites. Instead, severe declines in website usage were observed for all device users with the declines being more pronounced in mobile device users than in PC users. This is an admonitory caveat that reveals public health and pandemic prevention information announced on government websites cannot be effectively transmitted to the general public through official online platforms.Originality/valueThe study highlights the gap in information behavior and usage patterns between PC and mobile device users when visiting government websites. Although mobile devices brought many new visitors, mobile devices are ineffective in retaining visitors and continuous long-term use. The results of localize experience is helpful in the improvement of government website evaluation worldwide.

Post-Purchase Trust in e-Commerce: A Theoretical Framework and a Text Mining-Based Assessment Method

Post-purchase trust is formed after an online transaction is completed and the product or service is experienced. It influences consumers’ repurchase intention and the reputation of vendors. The aim of the current study was to deepen our understanding of post-purchase trust in e-Commerce and to develop a text mining-based assessment method by mining consumers’ online comments. By combining the expectancy-confirmation theory and product evaluation theory, this study proposes a comprehensive model of post-purchase trust encompassing consumers’ evaluation of product, delivery, service, and website. The model was verified by a survey involving 249 consumers. The results indicate that both product evaluation factors and transaction supporting factors have positive impacts on post-purchase trust. Based on this theoretical model, we proposed a text mining-based method to measure these factors through text-mining of consumers’ comments. To demonstrate the feasibility and benefits of the method, the method was applied to analyze 1,015,484 consumers’ comments on personal computer products from jd.com, a major Chinese e-Commerce website. The results suggest that the proposed method can provide practitioners with diagnostic suggestions to promote post-purchase trust and understand consumers better. HIGHLIGHTS Integration of the consumers’ product evaluation model and expectation-confirmation theory is proposed to investigate post-purchase trust in e-commerce. The confirmation of delivery, service, website, and perceived value of products affect consumer satisfaction, thereby affect post-purchase trust. Perceived value is positively affected by perceived price and perceived quality, which can be increased by consumers’ evaluation of the appearance, authenticity, and brand reputation of the product. The proposed model can be used to design text mining-based tools to monitor important factors of post-purchase trust via text mining.