Judgment Process Research Articles

GD03 Identifying core outcome domains and development of a cutaneous leishmaniasis core outcome measure for use in clinical practice and trials

Abstract Cutaneous leishmaniasis (CL) is caused by an intracellular protozoan parasite transmitted through a sand fly bite. A review of clinical trials examining different treatment modalities for CL found studies to be deficient in design, execution, analysis and reporting. Core outcome sets (COS), including agreed domains and measures, have been developed for several dermatological disorders. The aims of this study were to reach consensus on the most important core outcome domains to measure when assessing CL, agree on parameters to measure the domains and develop a clinical tool to assess CL. Potential outcome domains for CL were identified through a collaborative international approach involving virtual discussions and e-consultations with stakeholders, including teams caring for CL from Sri Lanka, India, Brazil and the UK. A subsequent judgement process was then undertaken, using the multidisciplinary stakeholder panel of international experts, adhering to nominal group technique to reach final agreement on the core outcome domains. Clinicians presented cases representing the clinical and psychosocial impact of CL to ensure the patient’s perspective was considered. Established core outcome domains included signs and symptoms (objective and subjective), treatment efficacy, treatment impact, clinical sequelae (scarring and pigment) and health-related quality of life (HRQoL). For each core outcome domain, a review of previous approaches to measure the domain was considered. Items to measure the domains were then evaluated by multiple rounds until the panel of experts reached consensus. It was agreed that ‘signs and symptoms’ should capture clinical morphology, diameter and induration of an index lesion with the aid of a palpability score; ‘treatment efficacy and impact’ should capture patient and investigator views through visual analogue scores, percentage change in size of the lesion and re-epithelialization compared with baseline. Sequelae assessment rated pigment, as well as atrophic and hypertrophic/keloid scars. Two open-ended questions were included as a means of capturing some aspects of HRQoL. CutLeishCOM was then generated to capture demographic details, reflect the core outcome domains and assess outcome measurements in each patient. CutLeishCOM has been validated in a small cohort in this study; further validation is required. A specific patient-reported outcome measure should also be considered to ensure adverse effects from treatments, and negative impacts are captured when assessing CL, thus enabling a patient-focused and empathic approach to management.

Do People Avoid Extreme Judgments in the Beginning? Calibration and Contrast as Explanations of Serial Position Effects in Evaluations

In serial evaluations (e.g., teachers evaluating student performances; managers evaluating job applications), people typically provide more extreme judgments at the end of a series compared to the beginning. Serial positions thereby represent an unwanted contamination of the judgment process; bad performances profit and good performances suffer from early positions. Prior research suggested a motivational calibration explanation: People withhold extreme judgments at the beginning to avoid consistency violations throughout the series. However, more extreme ratings at the end might also follow from comparison-based contrast effects. Three experiments (n = 509) tested the contributions of calibration processes at early positions and contrast effects at later positions to the overall serial position effect. The results replicated the avoidance of extreme judgments at early positions and provided support for comparison-based contrast (Exp. 1-3) and calibration influences (Exp. 3). These data suggest differential interventions to reduce unwanted serial position effects.

Research on critical thinking of pre-service mathematics education teachers in Indonesia (2015-2023): A bibliometric review

Critical thinking involves being mentally organized and participating in a judgmental process to solve problems. The purpose of this study is to look at the focus of research related to critical thinking of pre-service teacher teachers of mathematics education, especially in Indonesia from 2015 to 2023. The method used in this study is a descriptive bibliometric analysis method. The Scopus database is used to obtain the necessary data. The results of the research show that publications related to the critical thinking of pre-service teacher teachers of mathematics education in Indonesia have increased from 2018 to 2020. Most of the publications were published in conference papers and some were in Q2 journals. The research focus is divided into 4 sections, namely, 1) mathematics teacher , mathematical problems , algebra , and qualitative research ; 2) critical thinking skills , mathematics education , and learning systems ; 3) problem based learning and STEM; 4) data analysis techniques, information analysis. The material that is the focus of research is algebra. New themes for this field are experimental research, digital platforms, quantitative methods, and group theory. The keywords of critical thinking skills are not directly connected with these new themes

The politeness of criticism speech acts in Japanese and Minangkabau films

Criticism tends to be a face-threatening speech act that can endanger social relationships if not managed using appropriate strategies, especially in the intercultural context. This study aims to compare and contrast the politeness of criticism speech acts used in Japanese and Minangkabau languages as depicted in film series. The data on criticism speech acts in this study were collected from eleven Japanese film series with a total duration of 538 minutes and eight Minangkabau films with a total duration of 535 minutes. The collected data were formed into a set of data cards, classified based on the criticism speech acts strategies by Nguyen (2005), and analyzed based on Brown and Levinson’s (1987) politeness theory. The data classification in Japanese and Minangkabau was validated through the expert judgment process. The findings indicated that the Japanese and Minangkabau languages employed the same set of criticism speech act strategies but have different tendencies. In Japanese, speakers tend to use indirect strategies as their main criticism speech act strategy by ‘asking/presupposing,’ ‘correction,’ and ‘advice for change.’ Meanwhile, in Minangkabau, speakers tend to use direct strategies by using ‘negative evaluation,’ ‘expression of contradiction,’ and ‘disagreement’ strategies. Regarding the politeness strategy, off-record politeness strategies are more dominantly used among Japanese speakers. In contrast, Minangkabau speakers use bald on-record politeness strategies in criticism speech acts, reflecting their communication culture. The findings of this study provide a deeper understanding of criticism speech act and politeness strategies. The study is expected to contribute to the area of research on intercultural communication and Sociolinguistics.

Analysis of road network system development plans and strategies in West Papua

Manokwari Regency's development of a road network system is crucial to accelerating the improvement of the status of national roads, which are currently disrupting the convenience of road use and the surrounding community due to the degree of saturation being in category F, which includes limited traffic flow, low speed, volume below capacity, and a lack of safety features. Strategy III of West Papua Province's constructed road network system adaptations to local contexts and national hospitality strategies is selected using the Equal Important, Expert Judgment, and Analytical Hierarchy Process methodologies. Next, conduct a SWOT analysis, leading you to an IFE of 3.0 and an EFE of 2.86. To take advantage of chances and lessen the impact of threats, it is necessary first to identify the strategies of aggressive SO. Specifically, 64 SO techniques were identified by having managers and city planners mix 8 strength elements with 8 opportunity components. Unfortunately, few of these chimerical strategies performed well. West Papua's managers and city planners identified six feasible SO solutions to improve the city's transportation system.

The differences between normal and obese patient handling: re- structural analysis of two questionnaires

BackgroundPrecise causes of musculoskeletal complaints among nurses are not known well, but many studies have pointed to manual patient handling tasks. Subjective judgment and decision-making process for patient lifting is crucial for gathering data regards patient handling. The aim of this study was to consider reliability and validity and re-structure of two special tools for patient handling’s tasks.MethodsIn this cross- sectional study 249 nurses were fully participated. As recommended by literature for cultural adaptation of instruments, forward/backward translation method was applied. Reliability of the translated version was assessed by Cronbach’s alpha coefficient. Validity testing for the two scales was based on content validity index/ratio analysis and also Exploratory Factor Analysis was run to extract latent factors.ResultsReliability estimated by internal consistency reached a Cronbach’s Alpha of above 0.7 for all subscales of two questionnaires. After testing the validity, the final version of questionnaires was remained by 14 and 15 questions respectively.ConclusionsThese instruments evaluated for manual handling of normal and obese patients had acceptable validity and reliability in Iranian Nursing context. So, these tools can be used in further studies with the same cultures.

A Methodological Framework for Bridge Surveillance

The Italian “Guidelines for risk classification and management, security assessment and monitoring of existing bridges”, published in 2020 after the collapse of the Polcevera viaduct in Northern Italy, present a multilevel methodology that involves on-site operators and universities/research centers carrying out and validating a management process from on-site survey to the bridges’ condition assessment. The main goals of this process are to acquire appropriate knowledge of the current state and its evolution over time of the overall buildings that compose the infrastructures, with the aim to support the managing companies in a decision-making process and the purpose of guaranteeing service in full safety. In particular, the guidelines propose the use of engineered software platforms for data digitalization of the structures with the aim to create a Building Management System (BMS) in which the main historical and current state information is collected and can then be uploaded continually. In 2020, the CUGRI (Inter-University Research Center for the Prediction and Prevention of Major Hazards) and the SAM (Southern Highways Company) launched an innovative surveillance management model established on a multidisciplinary approach based on Geography Markup Language (GML), BIM tools, on-site interdisciplinary inspections, and multi-hazard analysis. The experimented methodology provides the on-site training of inspectors, the elaboration of suitable BIM models according to the above guidelines, and AINOP (National Archive of Public Infrastructures) requirements, and an expert judgement process for preliminary bridge assessment and data validation to support the maintenance managing process. The study presents an innovative operative model for the surveillance process, which integrates on-site expeditious inspections and multidisciplinary expert judgements by using an appropriate digitalization of the bridges with BIM and GIS technologies. The paper illustrates the experimental methodology performed on the A3 highway, which connects Naples to Salerno in Southern Italy, highlighting issues and opportunities, moreover in a first interdisciplinary contribution of object-oriented landslide mapping modelling.

개발행위허가에 관한 항고소송에서 사법심사와 증명책임

The burden of proof is a matter of which of the parties to the lawsuit is to be disadvantaged if the court cannot obtain certainty about the existence of essential facts in the final stage of the lawsuit. Furthermore, the burden of proof becomes the standard of action for the court and the parties throughout the entire process of litigation, and becomes an indicator of litigation command by the court and a goal of proof activities for the parties.
 Recently, the Supreme Court did Judgement that the broad deference should given to the legal requirement of environmental impact having prospective character and that the complainant should the burden of proof for the abuse of discretion. In environmental litigation, it is difficult to prove the causal relationship of environmental pollution, and protection is not sufficient with follow-up measures for environmental damage. In consideration of such points, it is persuasive to first respect the administrative judgment on environmental damage, and to judge that the decision is illegal only when it is unreasonable. However, when the burden of proof is heavy on one party, the possibility of remedies may be excessively limited.
 In the refusal of beneficial administrative acts corresponding to permits such as development permits, it is necessary to fairly distribute the burden of proof by considering the specificity of the appeal suit, the difficulty of proof, and the probability of factual existence.
 On the premise of the distinction between discretion and margin of judgment, the determination of whether or not the standards for permitting development activities are satisfied is a matter of judgment of a certain indeterminate concept among the action requirements.
 It is appropriate for the administrative agency to bear the burden of proof in cases where the margin for judgment is recognized as an area of professional and technical judgment. However, the planning act aspects of development permission should be considered. In terms of procedural legal control of planning discretion, the object of proof should be limited to the logical and technical validity of the judgment process or judgment method of disapproval decision.

The importance of situation evaluation and the ability to identify criteria in a construct-driven situational judgment test

Situational judgment tests (SJTs) typically focus on candidates' judgment of various response options and ignore the process of arriving at that judgment. In three studies, we developed two situational construal measures (i.e., situation evaluation and the ability to identify criteria [ATIC]) based on a construct-driven SJT measuring cooperativeness. We tested their role in the response judgment process and examined their incremental validity in predicting work performance. Study 1 (N = 30) provided qualitative evidence that situation evaluation and ATIC shape response judgment. Study 2 (Nstudent = 136, Nemployee = 154) showed that situation evaluation predicts response judgment. Moreover, situation evaluation had incremental validity in predicting supervisor-rated task performance and peer-rated interpersonal performance over and above response judgment and ATIC. Furthermore, ATIC predicted response judgment and had incremental validity in predicting interpersonal performance but not task performance over and above response judgment. Finally, Study 3 (N = 266) replicated the findings of Study 2 using a new sample and yielded similar results regardless of the order in which situation evaluation and response judgment were measured.

Individuating: how founder's social identities shape their evaluation of opportunities

PurposeThis paper adds to the ongoing debate on judgements, opportunity evaluation and founder identity theory and shows that founders vary in their prioritisation and combination of judgement criteria, linked to their respective social founder identity. It further reveals how this variation among founder identity types shapes their perception of distinct entrepreneurial opportunities and the forming of first-person opportunity beliefs.Design/methodology/approachThis study uses a qualitative approach by presenting three business scenarios to a sample of 34 first-time founders. It adopts a first-person perspective on their cognitive processes during the evaluation of entrepreneurial opportunities using verbal protocol and content analysis techniques.FindingsThe theorised model highlights the use of similar categories of judgement criteria by individual founders during opportunity evaluation that followed two distinct stages, namely search and validation. Yet, founders individualised their judgement process through the prioritisation of different judgement criteria.Originality/valueThe authors provide new insights into how individuals individuate entrepreneurial opportunities through the choice of different judgement criteria that enable them to develop opportunity confidence during opportunity evaluation. The study also shows that first-time founders depict variations in their cognitive frames that are based on their social identity types as they assess opportunity-related information and elicit variations in reciprocal relationships emerging between emotion and cognition. Exposing these subjective cognitive evaluative processes provides theoretical and practical implications that are discussed as well.

Sep-RefineNet: A Deinterleaving Method for Radar Signals Based on Semantic Segmentation

With the progress of signal processing technology and the emergence of new system radars, the space electromagnetic environment becomes more and more complex, which puts forward higher requirements for the deinterleaving method of radar signals. Traditional signal deinterleaving algorithms rely heavily on manual experience threshold and have poor robustness. To address this problem, we designed an intelligent radar signal deinterleaving algorithm that was completed by encoding the frequency characteristic matrix and semantic segmentation network, named Sep-RefineNet. The frequency characteristic matrix can well construct the semantic features of different pulse streams of radar signals. The Sep-RefineNet semantic segmentation network can complete pixel-level segmentation of the frequency characteristic matrix and finally uses position decoding and verification to obtain the position in the original pulse stream to complete radar signals deinterleaving. The proposed method avoids the processing of threshold judgment and pulse sequence search in traditional methods. The results of the experiment show that this algorithm improves the deinterleaving accuracy and has a good against-noise ability of aliasing pulses and missing pulses.

Justice, trust, and moral judgements when personnel selection is supported by algorithms

ABSTRACT Although algorithm-based systems are increasingly used as a decision-support for managers, there is still a lack of research on the effects of algorithm use and more specifically on potential algorithmic bias on decision-makers. To investigate how potential social bias in a recommendation outcome influences trust, fairness perceptions, and moral judgement, we used a moral dilemma scenario. Participants (N = 215) imagined being human resource managers responsible for personnel selection and receiving decision-support from either human colleagues or an algorithm-based system. They received an applicant preselection that was either gender-balanced or predominantly male. Although participants perceived algorithm-based support as less biased, they also perceived it as generally less fair and had less trust in it. This could be related to the finding that participants perceived algorithm-based systems as more consistent but also as less likely to uphold moral standards. Moreover, participants tended to reject algorithm-based preselection more often than human-based and were more likely to use utilitarian judgements when accepting it, which may indicate different underlying moral judgement processes.

Understanding Relevance Judgments in Legal Case Retrieval

Legal case retrieval, which aims to retrieve relevant cases given a query case, has drawn increasing research attention in recent years. While much research has worked on developing automatic retrieval models, how to characterize relevance in this specialized information retrieval (IR) task is still an open question. Towards an in-depth understanding of relevance judgments, we conduct a laboratory user study that involves 72 participants of different domain expertise. In the user study, we collect the relevance score along with detailed explanations for the relevance judgment and various measures of the judgment process. From the collected data, we observe that both the subjective (e.g., domain expertise) and objective (e.g., query/case property) factors influence the relevance judgment process. By investigating the collected user explanations, we identify task-specific patterns of user attention distribution and re-think the criteria for relevance judgments. Moreover, we investigate the similarity in attention distribution between models and users. Further, we propose a two-stage framework that utilizes user attention to improve relevance estimation for legal case retrieval. Our study sheds light on understanding relevance judgments in legal case retrieval and provides implications for improving the design of corresponding retrieval systems.

GIS-based Flood Risk Mapping: The Case Study of Kosi River Basin, Bihar, India

Flood risk mapping aims to create an easily read and rapidly accessible map to prioritize the mitigation effects. This study presents an empirical approach to flood risk mapping through the integration of Analytical Hierarchy Process (AHP) and Geographic Information System (GIS) techniques. SRTM 30m DEM is processed using ArcGIS 10.3 software. The study methodology includes the selection of the study area, the identification of the factors responsible for flood and collection of the required data, the generation of the desired thematic layers, and their integration to produce the flood risk map. Geomorphic, hydrologic, and socio-economic analyses are carried out to generate the thematic layers, namely slope, district`s distance to active stream, highest elevation, drainage density, rainfall, population density, and land use-land cover. AHP is used to determine the relative impact weight of the thematic layers. The influence of each thematic layer and the scale values provided based on the weights and score calculated by the AHP are used to integrate the layers in GIS environment to prepare the flood risk map. Consistency ratios are determined from the judgment process to validate the reliability of the proposed approach and results. The study classified the area falling in the basin under different risk zones with Purnia and Madhepura having large areas under high risk. This study may aid decision and policymakers in the evaluation and rapid assessment of flooding phenomena in the region.

Constraints of the constraints-led approach in American football and comments on Yearby et al. (2022)

ABSTRACT In recent literature, constraints-led approaches have been promoted for practice design to coaches of American football. While we agree that this approach would represent a useful tool, we put forward that ecological approaches alone are insufficient to address the complexity and diversity of real-world sporting contexts, so coaches must carefully consider how constraints-led approaches might fit within the total coaching process and associated challenges. With this in mind, this paper explores the implications and challenges of constraints-led approaches within the American football environment. In doing this, we consider the context and constraints of the game and their implications for both coaching practice and the implementation of ecological principles. To conclude, we also propose the need for pragmatic balance and consideration of approaches as part of a professional judgement and decision-making process by coaches.

Humans as intuitive classifiers.

Mainstream decision research rests on two implicit working assumptions, inspired by subjective expected utility theory. The first assumes that the underlying processes can be separated into judgment and decision-making stages without affecting their outcomes. The second assumes that in properly run experiments, the presentation of a complete description of the incentive structure replaces the judgment stage (and eliminates the impact of past experiences that can only affect judgment). While these working assumptions seem reasonable and harmless, the current paper suggests that they impair the derivation of useful predictions. The negative effect of the separation assumption is clarified by the predicted impact of rare events. Studies that separate judgment from decision making document oversensitivity to rare events, but without the separation people exhibit the opposite bias. The negative effects of the assumed impact of description include masking the large and predictable effect of past experiences on the way people use descriptions. We propose that the cognitive processes that underlie decision making are more similar to machine learning classification algorithms than to a two-stage probability judgment and utility weighting process. Our analysis suggests that clear insights can be obtained even when the number of feasible classes is very large, and the effort to list the rules that best describe behavior in each class is of limited value.

Correction, uncertainty, and anchoring effects.

We compare the predictions of two important proposals made by De Neys to findings in the anchoring effect literature. Evidence for an anchoring-and-adjustment heuristic supports his proposal that system 1 and system 2 are non-exclusive. The relationship between psychophysical noise and anchoring effects, however, challenges his proposal that epistemic uncertainty determines the involvement of system 2 corrective processes in judgment.

The Reciprocity Principle in Recognition and Enforcement of Foreign Judgements: Dilemma and Solutions

In China's judicial practice, de facto reciprocity is the underlying principle for recognition and enforcement of civil and commercial judgments and rulings by foreign countries with which China has not concluded bilateral or international treaties. The principle of reciprocity, now widely considered the key basis for recognition and enforcement of foreign judgments, should be reviewed since misuse of this principle may incur revanchism or impede the smooth enforcement of judgments. Based on the implementation of reciprocal recognition and enforcement of foreign judgments in China, the varied interpretations of judicial practice are critically analyzed, and suggestions for legislative and judicial practice are proposed from six perspectives including jurisdiction, due process, and legitimacy of judgments. The present work is intended to improve China's system of recognition and enforcement of foreign judgments and enhance China's image in international judicial practice.

Transforming Teaching of Foundational Nursing Skills to Enhance Clinical Reasoning Development: A Proposed Simulation Based Learning Activity

Over the past decade nurse educators have been called to transform nursing academia in order to better prepare our future nurses for the tremendous changes in the healthcare environment. The advancing medical technology, aging population, nursing shortages and recent COVID pandemic have provided unique challenges that require complex decision-making abilities. The National Council of State Boards of Nursing (NCSBN) has made significant changes in their licensure examination to accommodate the need to assess vital clinical judgment and decision-making skills in entry level graduate nurses. A model to measure clinical judgment was developed by NCSBN in 2019 to assist faculty in evaluating students beyond textbook nursing knowledge to actively perform and evaluate safe, effective clinical decisions. In order for students to fully grasp the clinical judgment process, faculty need to create active learning opportunities that provide patient context so students can cultivate clinical decision-making skills parallel to clinical knowledge. In nursing curricula, students learn fundamental skills in the first year of their education that provide them with a strong foundation to assess and care for thousands of patients. Transforming how these vital nursing skills are taught from solely performing the psychomotor learning domain to incorporating patient specific scenarios can foster development of clinical reasoning and sound clinical judgment in practice. This article outlines the transformation and redesign of teaching clinical skills to first semester nursing students to enhance clinical reasoning development and a proposed future study of assessing student outcomes using a simulation-based approach.

Auditors’ Perception of Their Regulator Within Their Social Group

Although copious literature exists on the judgment and decision-making (JDM) process, there is primarily anecdotal research on the personal perception of a regulatory body, such as the US Public Company Accounting Oversight Board (PCAOB). However, none have investigated its statistical impact on experts’ evaluation of another expert’s decision. A survey was conducted on 74 experienced auditors’ in-group members’ judgments and their perception of the regulator (PCAOB) to better understand the social group’s impact on professional judgments. The results reveal auditors’ evaluative decisions are positively associated with their perceptions of the regulator, inspection reports usage, and views of the PCAOB’s effectiveness.