Credibility Of Online Information Research Articles

Competency model development: The backbone of successful stealth assessments

AbstractBackgroundStealth assessment is a learning analytics method, which leverages the collection and analysis of learners' interaction data to make real‐time inferences about their learning. Employed in digital learning environments, stealth assessment helps researchers, educators, and teachers evaluate learners' competencies and customize the learning experience to their specific needs. This adaptability is closely intertwined with theories related to learning, engagement, and motivation. The foundation of stealth assessment rests on evidence‐cantered design (ECD), consisting of four core models: the Competency Model (CM), Evidence Model, Task Model, and Assembly Model.ObjectiveThe first step in designing a stealth assessment entails producing operational definitions of the constructs to be assessed. The CM establishes a framework of latent variables representing the target constructs, as well as their interrelations. When developing the CM, assessment designers must produce clear descriptions of the claims associated with the latent variables and their states, as well as sketch out how the competencies can be measured using assessment tasks. As the designers elaborate on the assessment model, the CM definitions need to be revisited to make sure they work with the scope and constraints of the assessment. Although this is the first step, problems at this stage may result in an assessment that does not meet the intended purpose. The objective of this paper is to elucidate the necessary steps for CM development and to highlight potential challenges in the process, along with strategies for addressing them, particularly for designers without much formal assessment experience.MethodThis paper is a methodological exposition, showcasing five examples of CM development. Specifically, we conducted a qualitative retrospective analysis of the CM development procedure, wherein participants unfamiliar with ECD applied the framework and showcased their work. In a stealth assessment course, four groups of students (novice stealth assessment designers) engaged in developing stealth assessments for challenging‐to‐measure constructs across four distinct projects. During their CM development process, we observed various activities to pinpoint areas of difficulty.ResultsThis paper presents five illustrative examples, including one for assessing physics understanding and four for the development of CMs for four complex competencies: (1) systems thinking, (2) online information credibility evaluation, (3) computational thinking, and (4) collaborative creativity. Each example represents a case in CM development, offering valuable insights.ConclusionThe paper concludes by discussing several guidelines derived from the examples discussed. Emphasizing the importance of dedicating ample time to fine‐tune CMs can significantly enhance the accuracy of assessments related to learners' knowledge and skills. It underscores the significance of qualitative phases in crafting comprehensive stealth assessments, such as CMs, alongside the quantitative statistical modeling and technical aspects of these assessments.

Iranian scientists and French showers: collaborative fact-checking of identity-salient online information.

In this study, we investigate what leads people to fact-check online information, how they fact-check such information in practice, how fact-checking affects their judgments about the information's credibility, and how each of the above processes is affected by the salience of the information to readers' cultural identities. Eight pairs of adult participants were recruited from diverse cultural backgrounds to participate online in joint fact-checking of suspect Tweets. To examine their collaborative deliberations we developed a novel experimental design and analytical model. Our analyses indicate that the salience of online information to people's cultural identities influences their decision to fact-check it, that fact-checking deliberations are often non-linear and iterative, that collaborative fact-checking leads people to revise their initial judgments about the credibility of online information, and that when online information is highly salient to people's cultural identities, they apply different standards of credibility when fact-checking it. In conclusion, we propose that cultural identity is an important factor in the fact-checking of online information, and that joint fact-checking of online information by people from diverse cultural backgrounds may have significant potential as an educational tool to reduce people's susceptibility to misinformation.

Impact of Credibility of Online Information on ADHD in the MENA Region

Recent studies have focused on mental and physical disabilities and disorders, particularly in the Arab world. However, there has been a lack of research on online information about attention deficit hyperactivity disorder (ADHD) and the discourse in which this information is presented on websites in the MENA region. This study aims to evaluate the credibility and accuracy of online information about ADHD, and the language discourse in which it is presented, in the Arab world. The study collected 22 landing pages of ADHD websites from ten Arab countries and applied three stages of inductive qualitative and partial quantitative approach: website credibility, website content analysis, and language discourse analysis. The findings showed that few websites(13%) had high credibility, and most did not have credibility elements on their landing page. Majority of the websites(86%) discussed key ADHD issues, but spread misleading information about ADHD. The discourse analysis revealed that some websites(23%) used authoritative discourse (AD), 27% used internal persuasive discourse (IPD), 23% used AD-IPD, and 27% were neutral. These findings suggest that the discourse used to discuss ADHD leans towards the AD where the science voice is dominant. This study highlights the need to improve the credibility, accessibility, and accuracy of online information on health-related topics, particularly for caregivers, parents, and teachers who are the first line spotters of ADHD symptoms in the MENA region.

What leads to online review helpfulness on e-commerce platform? Examining the moderating effect of high and low prices

Using signaling theory, this study unpacked the mechanisms through which online review information quality and reviewer information credibility influence online review helpfulness, in e-commerce context. Conducting a survey with users in Danang having read online reviews on Shopee.vn, 244 valid responses were used to evaluate the research model via PLS-SEM software. The study found that the information quality of online reviews strongly influences the helpfulness of online reviews compared to the information credibility of previous reviewers. Additionally, priced goods have a moderating effect on the relationship between online information credibility and online reviews helpfulness; and that relationship will be significant in high-priced products. This study makes a theoretical contribution to online reviews by elucidating the mechanisms of impact of review/reviewer information on reviews helpfulness and the moderating effect of product prices.

Impact of health-related internet use on disease management behavior of chronic patients: Mediating role of perceived credibility of online information

During the last two decades, Internet use has increased in all parts of the world. Although, the trend of actively using the Internet for seeking health-related information was already on the rise, it accelerated soon after the COVID-19 pandemic. Along with the increased use of the Internet for health decisions, serious concerns have been raised due to fake or misinformation. This study aims to determine the impact of Internet use for gathering health-related information on the disease management behavior of patients and to identify the mediating role of perceived credibility of online information. The study surveyed 200 chronic disease patients with diabetes and hypertension from the Pakistan Institute of Medical Sciences (PIMS), Islamabad, Pakistan. It is concluded that overall health-related Internet use has a positive impact on the disease management behavior of chronic disease patients. The study further confirms the mediating role of the perceived credibility of online information. Patients who are frequent users of the Internet for health information, who perceive online information more credible, reported better disease management behavior as compared to the less frequent users and those who perceive online information less credible.

Parental COVID-19-related health information practises, sources, evaluations and needs: A qualitative interview study.

Parents of infants and young children may have specific health information needs and preferences, as they are responsible for their children's health. COVID-19 posed many challenges for families, not least in terms of the constantly updated disease-prevention guidelines. However, little is known about parents' experiences with this unprecedented situation, that is, how and where they seek, useand evaluate COVID-19 (child)-specific health information. We aimed to find out more about this to provide insights to health (information) providers when communicating pandemic information to parents. We conducted semistructured telephone interviews (August to October 2020) with a purposively selected sample of 20 German-speaking and 10 Arabic-speaking parents of children up to 4 years old. Recruitment occurred through multiple channels, including childcare institutions and social media. Qualitative content analysis of the interview transcripts illustrates the main differences between the two groups. By the time the interviews were conducted (mid-2020), some parents reported to seek information less actively or not at all, compared to the beginning of COVID-19. German speakers frequently used Google to obtain information, whereas Arabic speakers mentioned social media (particularly Facebook) as a central source. However, medical providers were the most trusted source for child health. Though determining the credibility of online information was difficult for some parents, others, mostly German speakers (middle-high education), were aware of some author-related criteria. When deciding on information use, parents often rely on their own judgement and gut instinct. Besides the necessity to disseminate information via multiple outlets to reach all parents, Arabic speakers desired audio-visual and translation tools to facilitate understanding. Apart from education, language and knowledge of the health system and of the attributes of credible information may determine its quality and consequent decisions. There seems to be a considerable need to foster knowledge about reliable information sources, a greater understanding of the range of quality criteriaand specific support for nonnative speakers, not least to better inform parents' decision-making. A parent panel (n = 7) contributed to gathering ideas regarding recruitment, discussing initial resultsand the choice of topics and questions for a second interview phase.

Exploring Source Credibility when Communicating about Agricultural Science on Twitter

Universities must strategically communicate agricultural science to effectively reach millennials skeptical of agricultural innovations and constantly assessing the credibility of online information. Universities are trusted information sources and must maintain credibility on social media platforms such as Twitter, used by millennials to receive and share information. Source credibility seeks to understand message source and recipient characteristics that influence recipients’ perceptions of a source’s expertise and trustworthiness. The purpose of this study was to explore differences in engagement when specific factors affecting source credibility were emphasized when communicating with millennials about agricultural science on Twitter. The purpose was accomplished by describing the level of engagement and the differences in engagement observed between perceived gender, race, and age of university scientists. Over seven months, researchers wrote press releases about published journal articles authored by two or more diverse, university-affiliated scientists. They published multiple tweets about each release, with the only difference being the scientists’ headshots. Scientists were categorized as perceived male versus female, White versus Non-White, and older versus younger. Descriptive analysis of engagement metrics from 32 tweets found those with females performed better than those with males. Non-White scientist tweets performed better with the exception of engagement rate. Tweets featuring younger scientists received more engagement than older. The exploratory results implied tweets featuring young, Non-White females may elicit higher engagement. Future studies should examine if engagement metrics are correlated with source credibility dimensions. Strategically featuring diverse scientists in research communication may be utilized to build engagement in universities’ social media.

Barriers to Online Dementia Information and Mitigation.

There is growing interest in HCI to study ways to support access to accurate, accessible, relevant online health information for different populations. Yet, there remains a need to understand the barriers that are posed by the way our platforms are designed as well as how we might overcome these barriers for people with dementia. To address this, we conducted sixteen interviews and observation sessions with people with mild to moderate dementia. Our analysis uncovered four barriers to online health information and corresponding mitigation strategies that participants employed. We discuss how HCI researchers may apply these findings towards new technical approaches and standards concerning information accessibility and credibility for neurodiverse populations. Finally, we broaden the scope of HCI research to include investigations of the accessibility and credibility of online information for people with age-related cognitive impairment independent of proxies.

A COLLABORATIVE ONLINE READING AND RESEARCH PROJECT

This paper describes the conception and implementation of reading and research project designed to help students develop effective online reading and research skills. In addition to providing opportunities to practice traditional reading skills such as skimming, scanning, and critical reading, the project aims to help learners gain autonomous strategies for evaluating the credibility of online information. A student-centered, experiential learning approach to instruction framed the design. This required students to do most of the project work online, and involved a blend of face-to-face activity in computer laboratory along with out-of-class online collaboration. KEYWORDS: Collaboration, reading, face-to-face learning, online learning, project work online, teaching and learning

Assessing the Development of Digital Scientific Literacy With a Computational Evidence-Based Reasoning Tool

The evolving digital world requires scientifically literate citizens who are able to critically evaluate Internet sources of varying credibility. Instruction on evidence evaluation in postsecondary education often focuses on peer-review as a singular indicator of credibility. With increased access to web-based scientific information, students must also learn to think critically in real-time about the dimensions of credibility. This study describes the integration of sInvestigator, a computational evidence-based scientific reasoning tool, with a class of 32 students in an undergraduate honors course focused on socio-scientific issues. A cross-disciplinary team of researchers with expertise in science education, scientific literacy, and evidence evaluation developed and implemented an online questionnaire to measure students’ development of digital scientific literacy. After using sInvestigator to evaluate sources of scientific evidence based on publisher reputation, author competence, and author objectivity, students were better able to assess the credibility of online information. Results of this study also confirm the potential to authentically assess students’ use of author and publisher information to evaluate digital scientific sources. The need for further research on the operationalization and measurement of digital scientific literacy is discussed.

Role of Digital Skills in Refugee Integration

Two concurrent 21st-century phenomena—the nearly unprecedented number of forced migrants and the near ubiquity of information and communications technology—have given rise to increased scholarship in “digital migration studies.” One area of investigation in this emergent interdisciplinary field is the role of digital skills in refugee integration. Given the accelerated global reliance on technology resulting from the COVID-19 pandemic, the author conducted a state-of-the-art literature review to identify emerging issues and highlight research needs in this area. A search of 10 databases yielded 39 studies spanning the major resettlement regions (North America, Western Europe, Oceania), and including refugees from across the globe. The inclusion criteria were studies focused on refugees’ practical use of digital technology in integration, published from January 2020-April 2021. Exclusion criteria were studies on refugees in transit or protracted displacement, digital connectivity and accessibility, use of digital technology by humanitarian actors, software development, analyses of digital representations of refugees, public attitudes toward refugees as expressed in digital media, and literature reviews. Ndofor-Tah et al.’s (2019) Refugee Integration Framework was used to organize and synthesize the findings. The studies demonstrated how digital skills affect all domains of integration. Additionally, the studies confirm that many refugees in resettlement have limited digital skills for necessary integration tasks, such as navigating websites and assessing the credibility of online information. Limitations of this state-of-the-art review include its cross-sectional nature, having only one reviewer, and only published literature accessible online through public websites or subscription databases. An important emerging issue for future research is assessing, teaching, and learning digital skills among this population. The study's contributions to the knowledge base and theory, and its implications for information science scholars and practitioners and those in allied disciplines within digital migration studies, are discussed.

Algorithm for assessing the credibility of online information

The present paper is devoted to an algorithm for evaluating the data credibility and analyzes a number of available tools for this. During the investigation, it was foundt hat the most tools are used by journalists in doing this. Currently, there are attempts to automate the process of evaluating the information credibility, aimed not only at journalism professionals, but also at the regular user. In this sense, two tools wer eanalyzed: NewsGuard and WOT. The analysis of these tools allows us to determine the mechanisms of collective online analysis (crowdsourcing) in order to evaluate thecredibility of online information with the possible usage of computational intelligence without the mandatory experts’ participation. The developed algorithm takes over the best functions of the studied tools and can be useful for evaluating the data credibility from various websites.

Patient Utilization of Online Information and its Influence on Orthopedic Surgeon Selection: Cross-sectional Survey of Patient Beliefs and Behaviors.

BackgroundPatient attitudes and behavior are critical to understand owing to the increasing role of patient choice. There is a paucity of investigation into the perceived credibility of online information and whether such information impacts how patients choose their surgeons.ObjectiveThe purpose of this study was to explore the attitudes and behavior of patients regarding online information and orthopedic surgeon selection. Secondary purposes included gaining insight into the relative importance of provider selection factors, and their association with patient age and education level.MethodsThis was a cross-sectional study involving five multispecialty orthopedic surgery groups. A total of 329 patients who sought treatment by six different orthopedic surgeons were asked to anonymously answer a questionnaire consisting of 25 questions. Four questions regarded demographic information, 10 questions asked patients to rate the importance of specific criteria regarding the selection of their orthopedic surgeon (on a 4-point Likert scale), and 6 questions were designed to determine patient attitude and behaviors related to online information.ResultsPatient-reported referral sources included the emergency room (29/329, 8.8%), friend (42/329, 12.8%), insurance company (47/329, 14.3%), internet search/website (28/329, 8.5%), primary care physician (148/329, 45.0%), and other (34/329, 10.3%). Among the 329 patients, 130 (39.5%) reported that they searched the internet for information before their first visit. There was a trend of increased belief in online information to be accurate and complete in younger age groups (P=.02). There was an increased relative frequency in younger groups to perceive physician rating websites to be unbiased (P=.003), provide sufficient patient satisfaction information (P=.01), and information about physician education and training (P=.03). There was a significant trend for patients that found a surgeon’s website to be useful (P<.001), with the relative frequency increased in younger age groups.ConclusionsThis study shows that insurance network, physician referrals, appointment availability, and office location are important to patients, whereas advertising and internet reviews by other patients were considered to be not as helpful in choosing an orthopedic surgeon. Future studies may seek to identify obstacles to patients in integrating online resources for decision-making and strategies to improve health-seeking behaviors.

Preparing College Students for a Digital Age: A Survey of Instructional Approaches to Spotting Misinformation

Misinformation has become a regular feature of the Internet. Research suggests that everyone, including young people who have grown up with digital devices, struggles to differentiate fact from fiction online because they read closely rather than turning to external sources. We analyzed the resources students find when they seek advice offered by college or university websites on evaluating the credibility of online information. A random sample of 50 universities indicated that, for nearly all institutions, students are advised to engage in close reading to determine credibility. We conclude by recommending that institutions overhaul how they teach students to evaluate online sources.

Understanding the motivational values for the usage of specific online news media and users’ perception of information credibility

PurposeThe purpose of this study is to investigate the utilitarian value (UV), hedonic value (HV) and social value (SV) that make people use a certain type of online media website and how the usage of specific online media website impact the way people perceive online information credibility (OIC). A research model was also proposed to explain the essence of this study.Design/methodology/approachThis study adopted the survey research methodology to empirically test the research model with 873 research participants from the University of Science and Technology of China and Anhui Medical University.FindingsResults from structural equation modeling showed that UV and HV have a significant positive impact on the usage of print news media website (PNMW), usage of broadcast news media website (BNMW) and usage of social networking website (SNW). The SV was also found to have a significant positive impact on the usage of SNWs. The result also indicated that the usage of the PNMW and the usage of the BNMW by online users have a significantly positive impact on high rating of OIC. However, the result showed that the usage of SNW does not have a significant positive impact on the high rating of OIC.Originality/valueFindings in this study provided substantial contributions toward the advancement of the uses and gratification theoretical framework by unraveling how certain motivational values can influence online media users’ preferences for specific online media websites, as well as showing how specific online media websites affect online users’ perception of OIC.

Evaluating the quality and readability of online information on keratoconus treatment

ObjectiveThis study aims to evaluate the quality and readability of online resources on keratoconus treatment. MethodsA Google.com search was conducted on August 9, 2020; 32 web sites were selected for analysis. Popularity was assessed by Google and Alexa rank. The quality of web sites was analyzed using the quality criteria for consumer health information (DISCERN) tool, the Journal of the American Medical Association (JAMA) benchmark, and the Health On the Net Code of Conduct Certification (HONcode). The readability of the web sites was assessed using the Fleschwebr hea Reading Ease, the Automated Readability Index, and the Fleschted Readability ResultsThe JAMA benchmark scores, unlike the DISCERN scores, were correlated with the Google and Alexa rank. One web site (3.1%) met all the JAMA benchmark criteria, and 3 (9.3%) others had HONcode certification. The median DISCERN score was 33 (range, 29.6–43.1; maximum possible, 80). Rnib.org.uk scored the highest at 57 (71.0%). The mean Flesch–Kincaid Reading Ease score (52.9 ± 7.1) corresponded to uk" n DIdifficult to read.” Thirty-one web sites (96.8%) had a Flesch–Kincaid Grade higher than the American Medical Association recommendation of sixth grade level. The median Automated Readability Index score was 7 (range, 6.2–7.3). ConclusionThe majority of online information currently available on keratoconus treatment is complex and highly variable. Rnib.org.uk is the best currently available source. Clinicians should inform patients on how to assess the credibility of online information and recommend suitable information sources.

CREDBANK: A Large-Scale Social Media Corpus With Associated Credibility Annotations

Social media has quickly risen to prominence as a news source, yet lingering doubts remain about its ability to spread rumor and misinformation. Systematically studying this phenomenon, however, has been difficult due to the need to collect large-scale, unbiased data along with in-situ judgements of its accuracy. In this paper we present CREDBANK, a corpus designed to bridge this gap by systematically combining machine and human computation. Specifically, CREDBANK is a corpus of tweets, topics, events and associated human credibility judgements. It is based on the real-time tracking of more than 1 billion streaming tweets over a period of more than three months, computational summarizations of those tweets, and intelligent routings of the tweet streams to human annotators — within a few hours of those events unfolding on Twitter. In total CREDBANK comprises more than 60 million tweets grouped into 1049 real-world events, each annotated by 30 human annotators. As an example, with CREDBANK one can quickly calculate that roughly 24% of the events in the global tweet stream are not perceived as credible. We have made CREDBANK publicly available, and hope it will enable new research questions related to online information credibility in fields such as social science, data mining and health.

Critical Digital Literacy: EFL Students’ Ability to Evaluate Online Sources

The advancement of Internet-based technologies and the new media ecology have contributed to the increased reliance on online sources in both the academic and the non-academic contexts. This study investigated how students evaluated the credibility of online information and the bias that might have influenced the content of the information. 152 EFL students responded to the online critical literacy assessment, which consisted of six tasks: evaluating the credibility of visual information, evaluating WhatsApp message, comparing and evaluating websites, distinguishing between news and sponsored content, evaluating the credibility of claim in a YouTube video, and evaluating an Instagram post. The results of the study showed that the students were easily deceived by the online information they read from various online media. They particularly struggled to detect the unsubstantiated claims from the YouTube video. Despite being a generation Z who frequently used social media and various online sources in their daily lives, the students could not critically evaluate the claims posted on these platforms. Implications of this study include the need to incorporate critical digital literacy in the language skill courses and deliberate exposure to strategies in evaluating online sources.

ConvNet frameworks for multi-modal fake news detection

An upsurge of false information revolves around the internet. Social media and websites are flooded with unverified news posts. These posts are comprised of text, images, audio, and videos. There is a requirement for a system that detects fake content in multiple data modalities. We have seen a considerable amount of research on classification techniques for textual fake news detection, while frameworks dedicated to visual fake news detection are very few. We explored the state-of-the-art methods using deep networks such as CNNs and RNNs for multi-modal online information credibility analysis. They show rapid improvement in classification tasks without requiring pre-processing. To aid the ongoing research over fake news detection using CNN models, we build textual and visual modules to analyze their performances over multi-modal datasets. We exploit latent features present inside text and images using layers of convolutions. We see how well these convolutional neural networks perform classification when provided with only latent features and analyze what type of images are needed to be fed to perform efficient fake news detection. We propose a multi-modal Coupled ConvNet architecture that fuses both the data modules and efficiently classifies online news depending on its textual and visual content. We thence offer a comparative analysis of the results of all the models utilized over three datasets. The proposed architecture outperforms various state-of-the-art methods for fake news detection with considerably high accuracies.

E-WOM and Its Impacts on Purchasing Behavior: A Comparative Study between Thai and Indonesian Millennials

Social media has become a valuable information source that creates opportunities for users to share their comments about a product or service, establishing powerful electronic Word-of-Mouth conversations that may have an impact on purchasing behavior. The study aims to 1) study consumers’ perceptions towards the usefulness of electronic Word-Of-Mouth with respect to three factors, i.e. online information quality, online information credibility, and consumers’ attitude towards online information; 2) examine the influence of online information usefulness on online information adoption; and 3) examine the influence of online information adoption on consumers‘ purchase intentions. This study used an online survey to collect primary data from 200 Thai and 200 Indonesian millennial internet users. The result indicates a relatively distinctive result between Thai and Indonesian consumers, as Thai consumers focus mainly on their attitudes towards online information when they consider the usefulness of online information. On the other hand, Indonesian consumers focus on both their attitudes towards online information and the credibility of online information. Nonetheless, both groups share similar traits in other respects. Online information usefulness has an impact on online information adoption, while online information adoption produces a further impact on consumers’ purchase intentions.