Validity Issues Research Articles

How Mixed-Methods Research Can Improve the Policy Relevance of Impact Evaluations.

This paper describes how mixed methods can improve the value and policy relevance of impact evaluations, paying particular attention to how mixed methods can be used to address external validity and generalization issues. We briefly review the literature on the rationales for using mixed methods; provide documentation of the extent to which mixed methods have been used in impact evaluations in recent years; describe how we developed a list of recent impact evaluations using mixed methods and the process used to conduct full-text reviews of these articles; summarize the findings from our analysis of the articles; discuss three exemplars of using mixed methods in impact evaluations; and discuss how mixed methods have been used for studying and improving external validity and potential improvements that could be made in this area. We find that mixed methods are rarely used in impact evaluations, and we believe that increased use of mixed methods would be useful because they can reinforce findings from the quantitative analysis (triangulation), and they can also help us understand the mechanism by which programs have their impacts and the reasons why programs fail.

COMPONENTS OF SERVICE-DOMINANT LOGIC IN B2B MARKETING

Introduction. In the dynamic landscape of contemporary business, the traditional marketing concept undergoes critique due to its limitations concerning B2B interactions. The incongruity between theoretical developments and practical market needs has spurred the emergence of supplementary marketing disciplines, such as service marketing, relationship marketing, etc. The fragmentation of marketing theory has necessitated the formulation of a unifying paradigm that encompasses a multitude of aspects and challenges inherent to modern economics.
 Scholars S. Vargo and R. Lusch have proposed the concept of service-dominant logic as a unifying paradigm that emphasizes the central role of service, the concept of value, and co-creation as opposed to the mere exchange of products. In our view, within the debate regarding the role of service in marketing, attention should be directed toward the fundamental components of service-dominant logic, the role and influence of customers on value creation and service provision. Crucial questions include the alignment of market participants into networked structures (service ecosystems) and the search for sources of competitive advantage amidst rapid commoditization of almost any offering.
 The hypothesis of the scientific research consists in substantiating the prevalence of the service-dominant logic in B2B marketing compared to the traditional marketing concept and the decisive role of the customer experience as a source of competitive advantage.
 The purpose of the study is to examine the components of the service-dominant logic, to identify key distinctions from the traditional marketing paradigm, and to substantiate the significance of the customer experience in B2B marketing.
 The methodology of scientific research is general scientific research methods, including: induction and deduction, comparison, expert analysis, classification and description, evaluation grouping, and comparison methods.
 Conclusions and prospects for further research. Theoretical provisions of the service-dominant logic and its key distinctions from the traditional marketing paradigm were analyzed. The importance of the customer experience in B2B interactions was substantiated. Further research should focus on empirical validation and implementation issues of service logic, customer experience management and the principles of creation and functioning of service network structures.
 Keywords: service-dominant logic; customer experience; value co-creation; value proposition; resource integration; service ecosystem.

Exploring the Landscape of Indian Traditional Medicine in Rural Tamil Nadu: Knowledge, Attitudes, Practices, and Safety Concerns

Indian traditional medicine, encompassing systems such as Ayurveda, Siddha, and Unani, has been deeply rooted in the cultural heritage of the country for centuries. In rural Tamil Nadu, where these traditions have thrived, there exists a rich tapestry of knowledge, attitudes, and practices regarding traditional medicine. This study aims to delve into the landscape of traditional medicine in rural Tamil Nadu, shedding light on the depth of local knowledge, prevailing attitudes, prevalent practices, and pertinent safety concerns. Utilizing a mixed-methods approach, including qualitative interviews and quantitative assessments, data was collected from diverse rural communities across Tamil Nadu. Findings reveal a nuanced understanding of traditional medicine, deeply intertwined with cultural beliefs and socio-economic factors. Local communities demonstrate a profound knowledge of medicinal plants, formulations, and therapeutic practices passed down through generations. However, alongside this wealth of knowledge, concerns regarding safety, efficacy, and regulation persist. Attitudes toward traditional medicine are multifaceted, reflecting a blend of reverence, skepticism, and pragmatism. While many individuals continue to rely on traditional healers and remedies for primary healthcare needs, others express reservations, citing issues of standardization and scientific validation. Practices vary widely, from home remedies administered by family members to consultations with traditional practitioners and integration with modern healthcare systems. This study explores Indian traditional medicine in rural Tamil Nadu, highlighting safety concerns like adulteration and misidentification of plants. It suggests a comprehensive approach that integrates traditional and modern medicine, ensuring the safety and well-being of rural communities while addressing knowledge, attitudes, and practices. The approach places a strong emphasis on using data and statistics from secondary sources to discuss the article’s subject. It draws attention to how important the current social, political, and economic environment is in shaping the conversation.

Demonstrative Evidence and the Use of Algorithms in Jury Trials

We investigate how the use of bullet comparison algorithms and demonstrative evidence may affect juror perceptions of reliability, credibility, and understanding of expert witnesses and presented evidence. The use of statistical methods in forensic science is motivated by a lack of scientific validity and error rate issues present in many forensic analysis methods. We explore what our study says about how this type of forensic evidence is perceived in the courtroom – where individuals unfamiliar with advanced statistical methods are asked to evaluate results in order to assess guilt. In the course of our initial study, we found that individuals overwhelmingly provided high Likert scale ratings in reliability, credibility, and scientificity regardless of experimental condition. This discovery of scale compression - where responses are limited to a few values on a larger scale, despite experimental manipulations - limits statistical modeling but provides opportunities for new experimental manipulations which may improve future studies in this area.

THE STATE OF ESG DISCLOSURE: AN EXPLORATION OF STAKEHOLDERS AND SUSTAINABILITY MATERIALITY

The hospitality and tourism industry is known to be resource dependent and wasteful (e.g., water, energy, food, etc.). Given growing interest in the environmental, social, and governance (ESG)framework, hospitality and tourism companies’ civic duties are highlighted, and they are required to show their due diligence. From a risk management perspective, accounting, financial, and consulting institutions have introduced ESG disclosure and reporting systems, but these tools vary enormouslydepending on the industry, continents, and scope of the business. Retrieving the top 50 hospitality and tourism businesses’ ESG reports (by market capital), this study investigates the status of ESG disclosure and compliance. The findings of this study make important theoretical and practical contributions such that this study provides an important theoretical avenue for ESG conceptualization and addresses measurement validity and reliability issues. Practically, industry practitioners can detect the inequity in ESG reporting systems and identify lacking areas of ESG input.

Teachers’ Protective Factors of Resilience Scale: Factorial Structure, Validity and Reliability Issues

In the last years, few measurement scales have been introduced to explore the concept of teachers' resilience. While these instruments have made valuable contributions to the field, they have been criticized for their failure to encompass several pivotal protective factors that literature has identified as central to teachers' resilience. In response to this weakness, the Teachers' Protective Factors of Resilience Scale (TPFRS, Daniilidou & Platsidou, 2022) was created which addresses these limitations by including an assessment of both personal and environmental protective factors that influence teachers' resilience. In this context, the present study was undertaken with the aim of testing the factorial structure, reliability and construct validity of the TPFRS, as well as the preferred protective factors of 964 primary and secondary school teachers who participated in the study. The results confirmed that the TPFRS is a robust and valid instrument for assessing the protective factors that underlie teachers' resilience, whereas the predominant protective factors were (1) Teachers’ values and beliefs and (2) Emotional and behavioral competence. In conclusion, the TPFRS can be confidently recommended for use in subsequent research studies and interventions in the teaching profession.

The Adequacy of Physical Learning Facilities Supporting Students with Physical Disabilities (SWPDs) In Tanzania Secondary Schools

The goal of this study was to determine the suitability of the available physical learning facilities for students with physical limitations (SWPDs) in Tanzania Secondary Schools. The study was conducted in Dodoma region where two district councils were involved, namely Chamwino district council and Dodoma city council. The study covered classrooms, ramps, toilets, and laboratory and sports grounds facilities. The study took a quantitative approach and used a descriptive survey research design. A total of 327 people, comprising 294 teachers and 33 SWPDs, were randomly selected and asked to participate in the survey by responding to the questionnaires. It used questionnaires as a data collection instrument and a multistage procedure was also employed to get the participants who were teachers and students with physical disabilities. Frequencies and mean were used in a descriptive data analysis technique. Validity and reliability issues were well considered in this study in order to ensure achievement of the intended goals, dependability and consistency of the results. On the other hand, the study adhered to the ethical issues by considering privacy and confidentiality an act that ensured voluntarily and privacy participation of the respondents. The study discovered that the majority of schools lacked suitable basic physical facilities, resulting in a lot of children with special needs in the society being denied their right to attend and participate in learning activities at school. This implies that educational stakeholders ought to work hard ensuring availability of adequate and suitable supportive physical learning facilities for SWPDs in secondary schools.

Electric Area Conservation Rule and the Validity of Some Models of Subcycle Pulse Propagation

The validity issues of some approximations widely used to describe subcycle pulse propagation in various non-magnetic media are addressed. As the validity criteria we apply the fundamental electric area conservation rule, which directly follows from Maxwell’s equations in the 1D case. The general relations are derived for the possible values of the electric area in different media. It is shown that several theoretical models do not in general comply with the electric area conservation rule, which implies their limited applicability to correctly describe the subcycle pulse interaction with media. Therefore, any results obtained using such models cannot be taken as scientifically valid and meaningful.

An Assessment of Neoliberal Policy in Higher Education in Nepal: Political Economy Perspective

Nepal has adopted neo-liberal policy framework in education sector since 1997, just seven years of journey of free-market economic policy. The capitalist economy was modified by Washington Consensus which was based on financial instruments. Later, major policy framework adopted by Nepal is SDGs, which prescribed by neoliberalism, is more equitable, productive; environment friendly, inclusive and people empower friendly. The research question is whether WB funded educational reform project yields positive impact in socio-economic sector in Nepal. The objective of the study is to assess the overall impact of neoliberalist policy framework adopted in higher education in Nepal and to forward policy prescription.The secondary data has been gathered between the periods 1997-2020 and analysed descriptively. Post positivism research paradigm is adopted. Explanatory research design approach has been used and data is analysed descriptively. The validity and reliability issue of the study is addressed with sufficient data and appropriate data analysis techniques. The conclusion: the existing neoliberal policy framework needs to revaluate since its delivery measured in terms of inequality, unemployment, poverty, NOC, and capital flight for higher education in foreign university shows poor performance.

The hereditary abnormalities and genetic therapy of BCM

Blue cone monochromia is a visual disorder caused by genetic mutation, which is a single gene genetic disease thus very suitable for gene therapy. With this technique, mutations in patients' opsin genes can be repaired, thereby restoring their visual recognition of red and green. Compared with traditional treatment methods, gene therapy has obvious advantages in improving curative effect and is expected to achieve a radical cure of the disease. However, gene therapy still faces some challenges and limitations, such as technical validation, cost and accessibility issues. This review focuses on the progress of gene diagnosis and treatment technology in recent years and its application to blue cone monochromatic diseases. Further research and clinical practice will show more support and validation for the development of this treatment, thus providing patients with better treatment options.

Opportunities and challenges of computer aided diagnosis in new millennium: A bibliometric analysis from 2000 to 2023.

After entering the new millennium, computer-aided diagnosis (CAD) is rapidly developing as an emerging technology worldwide. Expanding the spectrum of CAD-related diseases is a possible future research trend. Nevertheless, bibliometric studies in this area have not yet been reported. This study aimed to explore the hotspots and frontiers of research on CAD from 2000 to 2023, which may provide a reference for researchers in this field. In this paper, we use bibliometrics to analyze CAD-related literature in the Web of Science database between 2000 and 2023. The scientometric softwares VOSviewer and CiteSpace were used to visually analyze the countries, institutions, authors, journals, references and keywords involved in the literature. Keywords burst analysis were utilized to further explore the current state and development trends of research on CAD. A total of 13,970 publications were included in this study, with a noticeably rising annual publication trend. China and the United States are major contributors to the publication, with the United States being the dominant position in CAD research. The American research institutions, lead by the University of Chicago, are pioneers of CAD. Acharya UR, Zheng B and Chan HP are the most prolific authors. Institute of Electrical and Electronics Engineers Transactions on Medical Imaging focuses on CAD and publishes the most articles. New computer technologies related to CAD are in the forefront of attention. Currently, CAD is used extensively in breast diseases, pulmonary diseases and brain diseases. Expanding the spectrum of CAD-related diseases is a possible future research trend. How to overcome the lack of large sample datasets and establish a universally accepted standard for the evaluation of CAD system performance are urgent issues for CAD development and validation. In conclusion, this paper provides valuable information on the current state of CAD research and future developments.

Stone Tools and Our Primate Relatives

Within three millennia, capuchins appear to have made substantial progress in their use of stones relative to other living non-human primates, including the great apes. The rapid evolution of capuchin tool use can help us better understand unclear aspects of our own evolutionary journey; it can also inform us of the decisions we may have to make regarding how we will share our planet with this primate in the future. However, no prior literature has comparatively examined capuchin and human lithics within naturalistic contexts to subsequently tackle the issues of pre-Clovis validity and future capuchin stone use. Therefore, I first review secondary data on the lithic items that capuchins have been interacting with over the last 3000 years in the first section of this paper. Subsequently, I discuss the similarities between present-day capuchin-made lithics and human flintknapping attributes. Essentially, capuchins have become proficient in the motor-skills required to detach flakes from stones in a manner somewhat similar to Oldowan hominins. However, capuchins do not modify these flakes; they use them expediently as a source of mineral nutrition or as hammerstones for percussion activities. In the second section of this paper, I examine literature related to archaeologically controversial sites that supposedly suggest human presence in the Americas predating 12,000 years ago. In particular, I compare capuchin lithics with secondary data from one Mexican site and one Brazilian site to argue whether the stone items at the two sites were made by: 1) neotropical primates; or 2) the forces of nature. Based on my discussion of capuchin lithic activities from past to present, I make a conjecture in the final section of this paper that the right set of conditions could enable modern capuchins to potentially begin intentionally detaching flakes for tool use over the next few centuries.

Teaching, learning, and assessment of science investigation in Year 11: Teachers’ response to NCEA

In New Zealand, the school science curriculum promotes openended science investigation, but the assessment regime in year 11 requires investigation with ‘direction’ and a more limited understanding of investigation. This case study research explored teaching practice and teacher understanding of science investigation, and the connectedness between learning, motivation to learn, and assessment. This paper presents the findings on teacher practice related to the teaching and assessment of science investigation. The results indicate that teacher practice of science investigation changed in response to the internal assessment requirements associated with science investigation for the National Certificate of Educational Achievement (NCEA). The nature of this change raises validity and reliability issues for the assessment of student learning of science investigation.

Subject Validity Issues and Potential Solutions in the Era of Metaverse–Starting with the Concern Over Property Rights in Crypto Art

In a pre-digital epoch, humans possessed the material means of production through material labor, which allowed them to exercise subjective agency and establish their existence as subjects through the acquisition of property rights. As digital technology has advanced, our digital being now forms an integral element of our fundamental human existence. In the age of the “metaverse,” we must confront and provide an answer to the topic of how to thrive better in the digital virtual world. The rise of Crypto Art, now imbued with a tangible worth by the incorporation of Blockchain technology and Non-Fungible Tokens in the artistic sphere, has opened new vistas for us to verify our subjects within the “metaverse”, thereby securing the liberty of our digital existence. However, crypto art, as digital labor under the techno-capitalist system, inevitably brings about the problem of alienation of digital laborers and their products, impacting the vulnerable subjects in the “metauniverse”. The communitarian mechanism and spirit of consensus inherent within the blockchain present potential pathways towards resolution. In addressing this predicament, crypto art must first transform into a societal intermediary committed to fostering a community centered around the sharing of digital resources. This would empower digital workers to genuinely possess their labor and acquire property rights on a public and communal platform, ultimately leading to the restoration of subjectivity.

Validity and reliability of SEIS-3: An instrument for subjective measuring of strength in older adults

The use of rating of perceived exertion (RPE) has grown substantially, providing a valuable alternative for exercise intensity monitoring, especially for older adults. However, some challenges, such as cross-cultural validity, age-related differences, and reliability issues, necessitate the development of a concise and user-friendly RPE instrument, particularly for strength training in this population. This study aimed to validate the Subjective Effort Induction Scale (SEIS-3), a simplified tool for measuring effort during strength training. SEIS-3 is a graded instrument with three exertion levels: 1) Light effort, 2) Moderate effort, and 3) Strong effort. Twenty seniors, aged 71±7 years, of both genders participated in the study (CEP/Unimontes 2,741,071/2018). We collected maximal isometric voluntary contraction (MIVC) data using a digital dynamometer. Subsequently, participants underwent the initial test, following the three SEIS-3 categories in a randomly assigned order of induced subjective effort. SEIS-3 instrument was evaluated by the approaches:•Linear regression analysis: employed to assess the validity of the instrument.•Intraclass Correlation Coefficient (ICC): employed to assess the reliability of the instrument.SEIS-3 effort categories correlated with MIVC in both hands (R2=0.80, F = 25.596, df=3, p < 0.01 for right hand; R2=0.56, F = 9.132, p < 0.01 for left hand). Test-retest reliability for grip strength across effort categories was excellent (ICC > 0.9). SEIS-3 is a valid and reliable user-friendly tool for accurately assessing and regulating exercise intensity in older adults during strength tasks, benefiting their health, functional capacity, and overall quality of life. This low-cost instrument can help health professionals in their activities.

Cefiderocol (CFDC): A Spy Antibiotic Future Replacement of Carbapenem

Cefiderocol, also known as CFDC, is an antibiotic in the class of cephalosporins. It is from the third generation. It is effective against gram-negative bacteria. 2019 was the year that it was given US FDA approval for use in the treatment of UTIs. In recent years, there has been a dramatic rise in the prevalence of MDR due to the increased use of antibiotics. Carbapenem, which is a broad-spectrum antibiotic, is unable to treat the illness for this reason because bacteria have developed resistance to it. In this scenario, cefiderocol may be used for the therapy of this kind of infection, and it would also be of special assistance for the treatment of GNB in individuals who have few other therapeutic options available to them. For this review, studies published between 2007 and 2023 are the primary focus of the debate. This review's supporting materials were sourced via a combined search of PubMed, PubChem, and Google Scholar, including the terms "Cefiderocol," "Carbapenem," "Gram-negative Bacteria," "Carbapenem Resistance," and "Cefiderocol clinical trials" from 2007 until May 2023. The focus of this paper is the difference in mode of action of these two antibiotics and shows valid issues for carbapenem resistance.

The nature of historical knowledge in large-scale assessments – a study of the relationship between item formats and offerings of epistemic cognition in the Swedish national test in history

Issues of validity and reliability have an impact on the construction of tests. Since the 2010s, there has been increasing emphasis in Sweden on enhancing reliability in the large-scale test system to combat grade inflation. This study aims to examine how this increased focus on reliability has affected how the nature of historical knowledge is presented in the national test in history. Accordingly, it addresses the following research question: what kinds of epistemic cognition does the test communicate to students? The concept of epistemic cognition builds on Kuhn et al.’s discussion on epistemic understanding, regarding the balance between the objective and subjective dimensions of knowledge. Furthermore, the concept of companion meanings is used to establish a connection between the items in the test and students’ epistemic cognition. The findings show that the selected-response tasks predominantly communicate an objective dimension of historical knowledge, while the constructed-response tasks communicate both subjective and objective dimensions of historical knowledge. The findings regarding the offerings of epistemic cognition are discussed in relation to validity, reliability, item formats and classroom practices.

ChatGPT's contributions to the evolution of neurosurgical practice and education: a systematic review of benefits, concerns and limitations

&amp;lt;p&amp;gt;&amp;lt;strong&amp;gt;Aim&amp;lt;/strong&amp;gt; &amp;lt;br /&amp;gt;This study provides a comprehensive review of the current literature on the use of ChatGPT, a generative Artificial Intelligence (AI) tool, in neurosurgery. The study examines potential benefits and limitations of ChatGPT in neurosurgical practice and education.&amp;lt;br /&amp;gt;&amp;lt;strong&amp;gt;Methods &amp;lt;br /&amp;gt;&amp;lt;/strong&amp;gt;The study involved a systematic review of the current literature on the use of AI in neurosurgery, with a focus on&amp;lt;br /&amp;gt;ChatGPT. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines were followed to ensure a comprehensive and transparent review process. Thirteen studies met the inclusion criteria and were included in the final analysis. The data extracted from the included studies were analysed and synthesized to provide an overview of the current state of research on the use of ChatGPT in neurosurgery.&amp;lt;br /&amp;gt;&amp;lt;strong&amp;gt;Results&amp;lt;/strong&amp;gt; &amp;lt;br /&amp;gt;The ChatGPT showed a potential to complement and enhance neurosurgical practice. However, there are risks and limitations associated with its use, including question format limitations, validation challenges, and algorithmic bias. The study highlights the importance of validating machine-generated content for accuracy and addressing ethical concerns associated with AI technologies. The study also identifies potential benefits of ChatGPT, such as providing personalized treatment plans, supporting surgical planning and navigation, and enhancing large data processing efficiency and accuracy.&amp;lt;br /&amp;gt;&amp;lt;strong&amp;gt;Conclusion&amp;lt;/strong&amp;gt; &amp;lt;br /&amp;gt;The integration of AI technologies into neurosurgery should be approached with caution and careful consideration of&amp;lt;br /&amp;gt;ethical and validation issues. Continued research and development of AI tools in neurosurgery can help us further understand their potential benefits and limitations.&amp;amp;nbsp;&amp;lt;/p&amp;gt;

The validation crisis in the L2 motivational self system tradition

AbstractConcerns have recently been raised about the validity of scales used in the L2 motivational self system tradition, particularly in relation to sufficient discriminant validity among some of its scales. These concerns highlight the need to systematically examine the validity of scales used in this tradition. In this study, we therefore compiled a list of 18 scales in widespread use and administered them to Korean learners of English (N = 384). Testing the factorial structure of these scales using multiple exploratory and confirmatory factor-analytic criteria revealed severe discriminant validity issues. For example, the ideal L2 self was not discriminant from linguistic self-confidence, suggesting that participant responses to such ideal L2 self items is not driven by actual–ideal discrepancies as previously presumed but more likely by self-efficacy beliefs. We discuss these results in the context of the need to encourage systematic psychometric validation research in the language motivation field.

Fisherman Insurance to Increase The Social Welfare of Fishers

The purpose of this study was to determine the active role of the Department of Marine Affairs and Fisheries of Takalar Regency, in supporting the process of the occurrence of Fisherman's Insurance that has been implemented by the central government, and to find out what factors hinder and support fishermen in obtaining Fisherman's Insurance cards. As for the determination of respondents using the Snowball technique or known as a snowball. Selected informants based on the criteria for receiving fisherman insurance cards as many as 25 informants as primary data sources. Data collection techniques are observation, distribution of questionnaires and interviews. This research was carried out in Sampulungan Village, Galesong District, Takalar Regency in March-May 2021. From the results of the research the socialization process planned and carried out by the Marine and Fisheries Service assisted by village officials was very effective in encouraging the enthusiasm of fishermen to obtain information and become insurance members fishermen, the supporting factors for implementing fisherman insurance consist of; High commitment from DKP Takalar Regency in realizing fishermen's insurance, enthusiasm of fishermen in obtaining information and being participants in fisherman insurance from the government, as well as high support from the village government in socializing and implementing fisherman insurance in Sampulungan Village. While the inhibiting factor is that there are still many fishermen who do not understand well the importance of being a member of fishermen's insurance; The existence of administrative data collection that has not been completed, including multiple lists, as well as the issue of validity of the fisherman's insurance card, which is only valid for one year, is considered short for fishermen.