Website Quality Evaluation Research Articles

Building an Expert System through Machine Learning for Predicting the Quality of a Website Based on Its Completion

The main channel for disseminating information is now the Internet. Users have different expectations for the calibre of websites regarding the posted and presented content. The website’s quality is influenced by up to 120 factors, each represented by two to fifteen attributes. A major challenge is quantifying the features and evaluating the quality of a website based on the feature counts. One of the aspects that determines a website’s quality is its completeness, which focuses on the existence of all the objects and their connections with one another. It is not easy to build an expert model based on feature counts to evaluate website quality, so this paper has focused on that challenge. Both a methodology for calculating a website’s quality and a parser-based approach for measuring feature counts are offered. We provide a multi-layer perceptron model that is an expert model for forecasting website quality from the “completeness” perspective. The accuracy of the predictions is 98%, whilst the accuracy of the nearest model is 87%.

Performance-Based Measurement of eHealth Literacy: Systematic Scoping Review

eHealth literacy describes the ability to locate, comprehend, evaluate, and apply web-based health information to a health problem. In studies of eHealth literacy, researchers have primarily assessed participants' perceived eHealth literacy using a short self-report instrument, for which ample research has shown little to no association with actual performed eHealth-related skills. Performance-based measures of eHealth literacy may be more effective at assessing actual eHealth skills, yet such measures seem to be scarcer in the literature. The primary purpose of this study was to identify tools that currently exist to measure eHealth literacy based on objective performance. A secondary purpose of this study was to characterize the prevalence of performance-based measurement of eHealth literacy in the literature compared with subjective measurement. We conducted a systematic scoping review of the literature, aligning with the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) checklist, in 3 stages: conducting the search, screening articles, and extracting data into a summary table. The summary table includes terminology for eHealth literacy, description of participants, instrument design, health topics used, and a brief note on the evidence of validity for each performance-based measurement tool. A total of 1444 unique articles retrieved from 6 relevant databases (MEDLINE; PsycINFO; CINAHL; Library and Information Science Abstracts [LISA]; Library, Information Science & Technology Abstracts [LISTA]; and Education Resources Information Center [ERIC]) were considered for inclusion, of which 313 (21.68%) included a measure of eHealth literacy. Among the 313 articles that included a measure of eHealth literacy, we identified 33 (10.5%) that reported on 29 unique performance-based eHealth literacy measurement tools. The types of tools ranged from having participants answer health-related questions using the internet, having participants engage in simulated internet tasks, and having participants evaluate website quality to quizzing participants on their knowledge of health and the web-based health information-seeking process. In addition, among the 313 articles, we identified 280 (89.5%) that measured eHealth literacy using only a self-rating tool. This study is the first research synthesis looking specifically at performance-based measures of eHealth literacy and may direct researchers toward existing performance-based measurement tools to be applied in future projects. We discuss some of the key benefits and drawbacks of different approaches to performance-based measurement of eHealth literacy. Researchers with an interest in gauging participants' actual eHealth literacy (as opposed to perceived eHealth literacy) should make efforts to incorporate tools such as those identified in this systematic scoping review.

Website Evaluation of DISPERDAG Section of the Average Price of Standard Needs Using the WEBQUAL 4.0 Method

DISPERDAG of Madiun City is one of the organizations that has utilized technology. The community can easily access and get price updates for basic necessities at Pasar Besar City of Madiun. The Internet helps support strong governance management, which benefits its effectiveness. Its functions include making it easier to get information, access public services, communicate with the public, and others. DISPERDAG aims to continue to provide quality services. The quality of services provided to the public must complement the implementation of website-based services so that the public continues to use SISKAPERBAPO services. To provide the best service to users, government institutions should prioritize service quality. Therefore, the success of the service quality of the SISKAPERBAPO website has not been known as long as the website is implemented. This is because there has never been an evaluation of website quality based on user satisfaction. It goes without saying that a website that is useful for assisting users in obtaining information must maintain quality in terms of information delivery and user interaction. Good service quality is offered from the user's point of view as well as the service provider's point of view.

Website quality evaluation: a model for developing comprehensive assessment instruments based on key quality factors

PurposeThe field of website quality evaluation attracts the interest of a range of disciplines, each bringing its own particular perspective to bear. This study aims to identify the main characteristics – methods, techniques and tools – of the instruments of evaluation described in this literature, with a specific concern for the factors analysed, and based on these, a multipurpose model is proposed for the development of new comprehensive instruments.Design/methodology/approachFollowing a systematic bibliographic review, 305 publications on website quality are examined, the field's leading authors, their disciplines of origin and the sectors to which the websites being assessed belong are identified, and the methods they employ characterised.FindingsEvaluations of website quality tend to be conducted with one of three primary focuses: strategic, functional or experiential. The technique of expert analysis predominates over user studies and most of the instruments examined classify the characteristics to be evaluated – for example, usability and content – into factors that operate at different levels, albeit that there is little agreement on the names used in referring to them.Originality/valueBased on the factors detected in the 50 most cited works, a model is developed that classifies these factors into 13 dimensions and more than 120 general parameters. The resulting model provides a comprehensive evaluation framework and constitutes an initial step towards a shared conceptualization of the discipline of website quality.

OLDER ADULTS’ ONLINE INFORMATION SEEKING FOR ALZHEIMER'S DISEASE

Abstract Many older adults use the internet to gather health information. Yet past research shows that older adults display less understanding of internet concepts and score lower on information-retrieving tasks than younger adults, making them more vulnerable to internet misinformation. To address this, a variety of guidelines (e.g., HONCode) have been developed to help consumers identify credible sources. This is especially relevant for Alzheimer disease (AD), as research has shown that online AD information is mixed in its quality. The purpose of this study was to examine how older adults gather online AD information and evaluate their ability to find credible sources to improve knowledge. We recruited 83 older adults (Mage = 70.0, 60.2% female; 85.5% White) who completed the Alzheimer Disease Knowledge Scale (ADKS; Carpenter et al., 2009) before and after engaging in six AD-related search tasks (e.g., identify age of onset, risk factors, treatment, etc.). Older adults utilized a variety of search strategies, visiting both reputable (i.e., not-for-profit or university-based) and less scrutinized (i.e., commercially sponsored) websites, and a vast majority (95.0%) were unaware of HONCode guidelines for evaluating website quality. While most participants could locate some AD-related information (97.6% identified risk factors), other information was more elusive (29.3% could not identify age of onset). Despite this, participants showed improved ADKS scores, t(74) = 5.55, p < 0.001. Our research shows that many older adults can gather some accurate online information about AD but may benefit from additional resources on using effective search strategies and identifying credible sources.

Assessing the readability and quality of online information about benign prostatic hyperplasia.

Benign prostatic hyperplasia (BPH) affects nearly half of men in their fifties. Patients often search the Internet to better understand their diagnosis, but online health information is not well regulated and can be difficult for patients to comprehend. This study aims to evaluate not only readability, but also the quality of online information about BPH, as well as the effect of commercial bias on readability and quality. Three search engines (Google, Bing, and DuckDuckGo) were used with broad search terms including "BPH," "BPH treatment," and "BPH surgery," to mimic a patient diagnosed with BPH seeking further information. 204 total websites were identified, of which 62 were unique websites. Among those unique websites, 23 were advertisements. Three readability formulas (Flesch-Kincaid Grade Level, Flesch-Kincaid Reading Ease, SMOG) were used to generate readability scores. DISCERN standardized questionnaire was used to evaluate website quality. Average reading level of online information about BPH was significantly higher than the recommended level by the American Medical Association (AMA) and United States Department of Health and Human Services (USDHHS). Advertisements had significantly easier readability than nonadvertisements. Average website quality was "excellent" for nonadvertisements, but only "fair" for advertisements. Although advertisements may hold optimal search result positions and have better readability than nonadvertisements, they have biased and lower quality information. It is important to guide patients to high quality online information of appropriate reading level. Continued efforts should be made to create and share with patients high quality resources with improved readability to facilitate comprehension and minimize misinformation.

Evaluation of Open Access Websites for Anesthesia Education.

While the prevalence of free, open access medical education resources for health professionals has expanded over the past 10 years, many educational resources for health care professionals are not publicly available or require fees for access. This lack of open access creates global inequities in the availability and sharing of information and may have the most significant impact on health care providers with the greatest need. The extent of open access online educational websites aimed for clinicians and trainees in anesthesiology worldwide is unknown. In this study, we aimed to identify and evaluate the quality of websites designed to provide open access educational resources for anesthesia trainees and clinicians. A PubMed search of articles published between 2009 and 2020, and a Startpage search engine web search was conducted in May 2021 to identify websites using the following inclusion criteria: (1) contain educational content relevant for anesthesia providers or trainees, (2) offer content free of charge, and (3) are written in the English language. Websites were each scored by 2 independent reviewers using a website quality evaluation tool with previous validity evidence that was modified for anesthesia (the Anesthesia Medical Education Website Quality Evaluation Tool). Seventy-five articles and 175 websites were identified; 37 websites met inclusion criteria. The most common types of educational content contained in the websites included videos (66%, 25/37), text-based resources (51%, 19/37), podcasts (35%, 13/37), and interactive learning resources (32%, 12/37). Few websites described an editorial review process (24%, 9/37) or included opportunities for active engagement or interaction by learners (30%,11/37). Scores by tertile differed significantly across multiple domains, including disclosure of author/webmaster/website institution; description of an editorial review process; relevancy to residents, fellows, and faculty; comprehensiveness; accuracy; disclosure of content creation or revision; ease of access to information; interactivity; clear and professional presentation of information; and links to external information. We found 37 open access websites for anesthesia education available on the Internet. Many of these websites may serve as a valuable resource for anesthesia clinicians looking for self-directed learning resources and for educators seeking to curate resources into thoughtfully integrated learning experiences. Ongoing efforts are needed to expand the number and improve the existing open access websites, especially with interactivity, to support the education and training of anesthesia providers in even the most resource-limited areas of the world. Our findings may provide recommendations for those educators and organizations seeking to fill this needed gap to create new high-quality educational websites.

Evaluating e-commerce website qualities: personality traits as triggers

PurposeThe five-factor model (FFM), a popular personality typology that identifies five key personality traits, has been used to predict use intention in various e-commerce applications, but the role of FFM in triggering certain evaluations of the various quality dimensions of e-commerce websites has not been examined, revealing a gap, i.e. the authors do not know how the five personality traits impact evaluations of the quality dimensions of e-commerce websites. The 3Q model—which comprises system quality (SysQ), information quality (IQ), and service quality (SQ), spanning 13 quality dimensions—is helpful for evaluating website quality, but the model neglects user characteristics and their impacts on quality evaluation, posing another gap, i.e. the authors do not know how user characteristics impact the user's evaluation of quality dimensions. Thus, the authors used the FFM to extend the 3Q model to explain how user personality predicts the evaluation of websites in the 13 quality dimensions.Design/methodology/approachThe authors used an online survey to collect responses from 392 online shoppers. Structural equation modeling was used to test the hypotheses.FindingsThe authors found that openness in a shopper predicts their favorable evaluation of a website in the quality dimensions of format and flexibility; conscientiousness predicts favorable evaluation in terms of completeness, accuracy, currency, timeliness, and service reliability; neuroticism predicts unfavorable evaluation in terms of reliability, accessibility, and assurance; and extraversion predicts favorable evaluation in terms of responsiveness; while agreeableness did not predict empathy.Originality/valueIn sum, the authors successfully used the FFM to theoretically extend the 3Q model, which clarifies the usefulness and pathways of personality in formulating strategies for e-commerce success.

Systematic literature review on university website quality

Website is a necessity for organizations to enable users worldwide to access their information and gain a competitive edge over others. The diversity of websites makes assessing website quality a difficult task. The aim of this paper is to identify the issues faced in the quality evaluation of university websites, the models and the factors used for evaluating university website quality. Systematic literature review was used to identify and synthesize related scholarly research papers. Findings show that there is a lack of study on university website quality compared to business websites; website designers did not have the appropriate knowledge on the interface design; and the website quality evaluation is complex since there is no specific evaluation model. Webqual 4.0 model was used to evaluate the quality of universities' websites. From 24 studies, initially 79 quality factors were extracted. After performing comparison, filtration and memoing, six quality factors were identified: information quality, specific content, usability, web appearance, service interaction quality, and functionality. This study makes a useful contribution in developing university website quality model by extending the Webqual 4.0 model.

Evaluating website quality: which decision criteria do consumers use to evaluate website quality?

PurposeThe purpose of this paper is to determine which design and operational attributes of e-commerce websites consumers use to assess website quality. Cue utilization theory is used to examine the explanatory power, robustness and relevance of the WebQual model. Results indicate which WebQual dimensions are the most relevant and salient to website users. These dimensions are categorized by their perceived and confidence values. A second study is conducted about how website users evaluate and utilize the WebQual dimensions.Design/methodology/approachSurvey methodology was utilized to provide insight into the nomological validity of the WebQual model by examining it through a cue utilization lens.FindingsThe first study categorizes the WebQual dimensions on their ability to provide a diagnostic measure of website quality, and consumer confidence in their ability to use these cues when judging the website's overall quality. The second study presents results of each dimension in relation to the quality evaluation of an actual e-commerce website. Additional analysis also revealed gender differences in cue utilization.Originality/valueThis study provided insight into WebQual-based research and identified original differences in cue utilization across genders. Results suggest that it may be beneficial for brand managers to focus on a subset of quality dimensions, rather than assume that consumers are comfortable using all website attributes to formulate quality judgments. These, results contribute to multiple literatures by providing a model that developers can utilize to focus on the deterministic characteristics of overall website quality. Further, the cue utilization perspective provides additional avenues for fruitful further research into consumer decision-making in the e-commerce context.

Readability, quality, and timeliness of patient online health resources for urticaria

Readability, quality, and timeliness of patient online health resources for urticaria

Applying an AHP Technique for Developing A Website Model of Third-Party Booking System

This study develops a model for selecting between third-party booking systems from a consumer perspective based on previous information/e-commerce systems success models and a hospitality website quality evaluation model. Factors influencing consumers’ selection of third-party booking systems are identified and the relative importance of each is revealed through the analytic hierarchy process technique. Data is collected from two waves of online surveys and analyzed with the Expert Choice software package. The results reveal the following priorities of factors: security oriented, information quality, service quality, system quality, and marketing oriented. Similarities and differences between these findings and those of past studies are discussed. Based on the analytic hierarchy process results, a practitioner guide on how to design a successful third-party booking system is presented. The developed model is different from hotel selection models and displays more theoretical completeness.

How Users' Gaze Behavior Is Related to Their Quality Evaluation of a Health Website Based on HONcode Principles?

While the health website is an easily accessible source for patients to use when seeking health information, the quality of online health information has been a critical issue that concerns all stakeholders in healthcare. The aim of this research was to examine the relationship between users' evaluation of the health website quality and their gaze behavior on the web pages. Eye tracking and a self-report questionnaire based on the HONcode principles were used to address the objective. We found that (1) the evaluations of authority, privacy, financial disclosure, and advertising policy are positively correlated with the fixation count and total fixation duration toward corresponding page components, while the evaluations of complementarity and attribution are negatively correlated with the fixation count and total fixation duration to corresponding page components; and (2) the fixation count and total fixation duration toward health information sources are negatively related to the evaluation of health website quality, while the fixation count and total fixation duration to site owner are positively related to the quality evaluation. Users' attention to page components is closely related to the evaluation of principles, and also has a certain impact on the overall quality evaluation of a health website. Based on the findings, our research may serve to improve the health website design and be a foundation to develop an automatic evaluation approach of the health website quality.

Website Quality in Asia: Testing a Measurement Instrument in a Chinese Context

In this study we investigate the psychometric properties of a Chinese version of a perceived website quality (PWQ) measurement instrument. The results of our study confirmed the four-factor structure of the scale scores and that the scale has good internal consistency. CFA results support the convergent and discriminant validity of the scales scores for the first factor measurement model. Our findings also showed that a single higher-order factor accounts for the variance among the four lower-order factors. In view of its sound psychometric properties, the Chinese version of the PWQ scale is a useful instrument to evaluate website quality in a Chinese context.

Evaluating the Quality of Online Health Information about Prostate Cancer Treatment.

Prostate cancer is the second most common cancer in men. It is common for patients to search the Internet before and after urological consultation to better understand their diagnoses. Unfortunately, online health information is largely unregulated and may be difficult for patients to comprehend. This study aims to evaluate the readability and quality of websites describing prostate cancer treatments. Three search engines were used to search the terms "prostate cancer" and "prostate cancer treatments" to replicate a patient seeking self-education about prostate cancer; 40 websites were identified. After excluding websites with membership fees and publicly editable content, 26 websites were analyzed; 7 were marked as advertisements. Three readability formulas (Flesch-Kincaid Grade Level, Flesch-Kincaid Reading Ease, Simple Measure of Gobbledygook) were used to generate readability scores. The DISCERN standardized questionnaire was used to evaluate website quality. Compared to readability scores at the American Medical Association recommended seventh grade reading level, mean readability scores for the websites analyzed were significantly higher and translated to the tenth to eleventh grade reading level. The mean DISCERN score for all websites was 47, equating to "Fair" quality. Nonadvertisement websites had significantly higher scores than websites marked as advertisements, with nonadvertisements rated "Good" quality and advertisements rated "Poor" quality. Most websites about prostate cancer treatment are written at a reading level too advanced for a large proportion of Americans to understand. Some optimally positioned websites are advertisements that contain poor quality information. It is the responsibility of clinicians to guide their patients toward appropriate online resources.

Framework of Public Agency Website Quality Evaluation in the UAE

Website quality is among the key drivers of the success of e-government transformation as citizens are more likely to participate when they found a satisfying engagement with a website. This paper proposed a framework of public agency website quality evaluation for the National Media Council, UAE. The study used a quantitative approach where a survey strategy was used to administer questionnaires to users of an agency’s website. A total of 185 questionnaires were analysed using Partial Least Squares Structural Equation Modelling software (SmartPLS version 3.2.6). The result revealed that website quality had a statistically significant effect on user satisfaction. Similarly, it was further found that website quality had a statistically significant effect on perceived service quality. The result implies that users of NMC website interpret the quality of the agency’s website from the purview of the satisfaction they derive from visiting the website and the perceived quality of the service offered through browsing the website.

Evaluasi Kualitas Website Pemerintah Daerah Dengan Menggunakan WebQual 4.0 Pada Instansi Pemerintahan ABC

The purpose of website quality evaluation is helping ABC Government Institution to determine the significant influence of usability, information quality, and service interaction as a whole and partially. The research examines the relationship of usability, information quality, and service interaction in influencing the quality of the website in accordance with the reference webQual 4.0, by distributing questionnaires data processed using SPSS and analyzed by multiple regression analysis methods. The results of the analysis of all questions in the questionnaire were valid and reliable, the Cronbach alpha value for each statement> 0.1875. The influence of X1 usability, X2 information quality, and X3 service interaction variables on website Y1 quality is 63.8%. The value of Adjusted R Square is 0.407 or 40.7% the influence of independent variables on the dependent variable. In this study, the regression model equation is Y = 0.96 + 0.517X1 + 0.754X2 + 0.760X3. The evaluation of website quality should be done on dimensions or variable usability. Thus, the respondents feel less understanding or have inconvenience in operating the website, and also find some difficult to explore the website.Keywords: Evaluation, WebQual, Regression

Double-entry analysis system (DEAS) for comprehensive quality evaluation of websites: case study in the tourism sector

A new analysis system for evaluating website quality is presented. It is characterized by its ability to interrelate and evaluate both technical and strategic aspects of a website. It is based on the premise that, while the technical aspects that govern the operation and functionality have a great impact on the quality of a website, they do not guarantee its success on their own. This approach differs from those commonly adopted in analysis systems, since until now most of them have been developed by adopting a predominantly operational or functional view.

Website Quality Evaluation Methodology Universal Star: 1st point – “Content”

The Internet continues to grow at a fast pace with over 1.5 billion websites in 2019 as compared with only one in 1991. The emergence of enormous websites of various complexities and types makes assessing the quality of these sites a vastly important, difficult and complicated task. With this concern, the current paper proposes a novel approach for website assessment by developing a new Website Quality Evaluation Methodology Universal Star (WQEMUS) with a theoretical and empirical basis. It became possible through the employment of the grounded theory methodology that enables relevant concepts to emerge from data. To improve the reliability and validity of the findings, an extensive literature review, in-depth and qualitative interviews, and a user evaluation survey were conducted and associated together. In this way, the study presents the results of the selection and categorization of generic quality attributes for WQEMUS with a three-tier structure, consisting of top-level quality criteria, sub-criteria and indicators. These quality dimensions are grounded on a combination of subjective and objective indicators. Consequently, WQEMUS becomes capable of estimating a wide range of different websites irrespective of domain affiliation and services they provide, including Web 3.0 sites.

Evaluation of Quality of Websites Related to Sexaholics Anonymous: Improvement of Online Patient Education in High Risk Sexual Behaviors

Background: The internet advising system is growing as the essential means of health. Regarding the importance of addictive disorders as well as the requirement for websites to provide up-to-date information about such disorders and inform patients how to prevent and treat them, the structure and content of these websites are extremely crucial. Objectives: This research aimed to evaluate websites presenting information on treatment for sex addiction in Sexaholics Anonymous (SA) to users and also to compare the quality of related Persian and English websites. Patients and Methods: This cross-sectional study reviewed six websites addressing SA found through the use of the Google and Yahoo search engines by searching four key terms (behavioral addiction, sex addiction, sex, treatment of sex addiction). Two Persian and four English websites related to SA were found. Each website was assessed using the Website Quality Evaluation Tool by 42 research assistants based on indicators including content, functionality, being up-to-date, links, graphics, authority, coverage and style. Results: Overall, the quality of websites related to SA was “trustable”. There was no significant difference between the total scores of the quality of the SA-related websites. Moreover, a significant difference was found between the English and Persian websites in terms of being up-to-date sub-criterion (P = 0.007). Conclusions: The websites related to SA met the user’s needs. The scores of the Persian websites were lower than those of the English ones. Treatment programs for sex addiction within the Iran health system remain limited. This study suggests that we should use technology in national healthcare services, especially in the area of web and databases.