Multistage Evaluation Research Articles

Multi-Stage Evaluation Using GONUKE

Multi-stage validation (MSV) has become an important concept in nuclear power plant control room design and modernization. MSV consists of multiple stages of collecting evidence that establish reasonable confidence in the design. The Guideline for Operational Nuclear Usability and Knowledge Elicitation (GONUKE) was created as a framework to support different types of human factors evaluations across different stages of the design and development life cycle. The GONUKE framework did not originally address MSV, but it espoused safety case approaches that build different evidences toward design completion, which is a complementary approach to MSV. In this paper, we show how GONUKE specifically aligns to MSV. We then expand the discussion to include multi-stage evaluation. As defined in GONUKE, there are three types of evaluation. Validation is empirical evidence collected through human-in-the-loop studies, whereas verification is expert comparison of a design against formalized standards, and epistemiation is expert knowledge transfer to design.

Development of the Better Research Interactions for Every Family (BRIEF) intervention to support recruitment for neonatal clinical trials: an intervention mapping guided approach

BackgroundRecruitment for neonatal clinical trials can be particularly challenging. Low enrollment rates bias the research population and decrease generalizability of findings. We identified a critical need for an intervention to improve how researchers recruit for neonatal clinical trials. Working within the US neonatal research context, we developed the Better Research Interactions for Every Family (BRIEF) Intervention, which had two overarching goals: to improve the recruitment experience for all parents, focusing on minoritized populations, and to increase participation, focusing on decreasing disparities in research participation.MethodsWe used intervention mapping (IM) to guide all steps of intervention development. IM is a planning framework that provides a systematic process and detailed protocol for step-by-step decision-making for intervention development, implementation, and evaluation.ResultsWe performed IM’s six steps. In step 1, we convened two stakeholder groups, a parent panel and an expert panel, who provided guidance through development of all BRIEF components. Through a recent systematic review, empirical data collected by our team, and consultations with the panels, we identified key determinants (barriers and facilitators) of low enrollment rates and research team members as change agents. In step 2, we iteratively refined our list of key factors to include and linked determinants of behavior changes to these performance objectives. In step 3, we chose three theories (social cognitive theory, theory of information processing, and the trans-theoretical model), methods from identified practical applications suitable for the population (research team members) and the context (busy research NICU teams). In step 4, we developed and refined the intervention components, including self-guided pre-work and a single in-person session. In step 5, we identified the Darbepoetin plus slow-release intravenous iron trial as our partner study in which to pilot BRIEF. In step 6, we developed a multi-stage evaluation plan that included five distinct levels of outcomes.ConclusionsThis manuscript shares our rationale and processes for the creation of a research team member-facing intervention aiming to improve recruitment processes for neonatal clinical trials. Our approach can inform those aiming to improve recruitment for neonatal clinical trials and those who may be considering use of IM within similar contexts.

Developing and validating a framework to explain cruise travel intention in the United States: a crisis management perspective

PurposeThis study aims to extend the cognitive appraisal theory by developing and validating a conceptual framework to illustrate how travelers' behavioral intention is generated via a multi-stage evaluation of health-related variables.Design/methodology/approachSEM and moderator analysis were conducted to examine the theoretical framework (post-intervention event travel intention) and to investigate how the appraisal process differs across travelers with various attitudes toward vaccination.FindingsThis study found that cruise travel intention was positively influenced by the perceived hedonic value and perceived trustworthiness and negatively influenced by perceived infection risk. Furthermore, whereas perceived hedonic value, perceived trustworthiness and perceived risk of infection were all predicted by crisis management, the dimensions of crisis management operated differently. In addition, vaccination attitudes amplified the unfavorable effect of perceived risk on intention.Originality/valueDrawing on the CAT, this study developed and validated a conceptual framework to integrate crisis management with customers' behavioral intentions. This study extends existing cruise travel intention theory by demonstrating how post-pandemic travelers' behavioral intention is generated via a multi-stage appraisal-reappraisal process based on the evaluations of infection risks and cruise line crisis management.

Towards Time-Resolved Multi-Property Measurements By Single-Frequency FRS

The filtered Rayleigh scattering technique (FRS), extended by the method of frequency scanning, has historically been limited to time-averaged multi-property flow measurements. In our recently published work, we present a concept that potentially enables the combined measurement of time-resolved pressure, temperature and three-component (3C) velocity fields. It is based on the observation of the region of interest from six perspectives and a single excitation frequency. This work summarizes and expands on a follow-up publication that experimentally verifies this concept on an aspirated circular duct flow. For this purpose, the results obtained from single-frequency data processing are compared with reference pressures, temperatures and corresponding LDA velocity measurements. Overall, a very good agreement is found for all operating points with accuracies of 3.4% in pressure, 1.3% in temperature and ±2 m/s in axial velocity. Concerning precision, a newly developed multistage evaluation procedure enables values for pressure, temperature and velocity as low as 3 hPa, 2.2 K and 1.7 m/s. In a second flow configuration, an axial swirler is introduced into the duct. The resulting secondary flow structure and deformation of the axial velocity field caused by swirler geometry and support are very well captured with the single-frequency analysis. A closing discussion on the implementation challenges of a single-frequency multi-property FRS instrument with pulsed laser radiation reveals significant obstacles to overcome. Due the considerable optimization potential identified, chances are high that true time-resolved multi-property measurements by FRS will become a reality.

Evaluating emotional and subjective responses in synthetic art-related dialogues: A multi-stage framework with large language models

The appearance of Large Language Models (LLM) has implied a qualitative step forward in the performance of conversational agents, and even in the generation of creative texts. However, previous applications of these models in generating dialogues neglected the impact of ‘hallucinations’ in the context of generating synthetic dialogues, thus omitting this central aspect in their evaluations. For this reason, we propose an open-source and flexible framework called GenEvalGPT framework: a comprehensive multi-stage evaluation strategy utilizing diverse metrics. The objective is two-fold: first, the goal is to assess the extent to which synthetic dialogues between a chatbot and a human align with the specified commands, determining the successful creation of these dialogues based on the provided specifications; and second, to evaluate various aspects of emotional and subjective responses. Assuming that dialogues to be evaluated were synthetically produced from specific profiles, the first evaluation stage utilizes LLMs to reconstruct the original templates employed in dialogue creation. The success of this reconstruction is then assessed in a second stage using lexical and semantic objective metrics. On the other hand, crafting a chatbot’s behaviors demands careful consideration to encompass a diverse range of interactions it is meant to engage in. Synthetic dialogues play a pivotal role in this context, as they can be deliberately synthesized to emulate various behaviors. This is precisely the objective of the third stage: evaluating whether the generated dialogues adhere to the required aspects concerning emotional and subjective responses. To validate the capabilities of the proposed framework, we applied it to recognize whether the chatbot exhibited one of two distinct behaviors in the synthetically generated dialogues: being emotional and providing subjective responses, or remaining neutral. This evaluation will encompass traditional metrics and automatic metrics generated by the LLM. In our use case of art-related dialogues, our findings reveal that the capacity to recover templates or profiles is more effective for information or profile items that are objective and factual, in contrast to those related to mental states or subjective facts. For the emotional and subjective behavior assessment, rule-based metrics achieved a 79% of accuracy in detecting emotions or subjectivity (anthropic), and an 82% on the LLM automatic metrics. The combination of these metrics and stages could help to decide which of the generated dialogues should be maintained depending on the applied policy, which could vary from preserving between 57% to 93% of the initial dialogues.

Stress adaptive plasticity from Aegilops tauschii introgression lines improves drought and heat stress tolerance in bread wheat (Triticum aestivum L.).

Aegilops tauchii is a D-genome donor of hexaploid wheat and is a potential source of genes for various biotic and abiotic stresses including heat and drought. In the present study, we used multi-stage evaluation technique to understand the effects of heat and drought stresses on Ae. tauschii derived introgression lines (ILs). Preliminary evaluation (during stage-I) of 369 ILs for various agronomic traits identified 59 agronomically superior ILs. In the second stage (stage-II), selected ILs (i.e., 59 ILs) were evaluated for seedling heat (at 30°C and 35°C) and drought (at 20% poly-ethylene glycol; PEG) stress tolerance under growth chambers (stage-II). Heat and drought stress significantly reduced the seedling vigour by 59.29 and 60.37 percent, respectively. Genotype×treatment interaction analysis for seedling vigour stress tolerance index (STI) identified IL-50, IL-56, and IL-68 as high-performing ILs under heat stress and IL-42 and IL-44 as high-performing ILs under drought stress. It also revealed IL-44 and IL-50 as the stable ILs under heat and drought stresses. Furthermore, in the third stage (stage-III), selected ILs were evaluated for heat and drought stress tolerance under field condition over two cropping seasons (viz., 2020-21 and 2021-22), which significantly reduced the grain yield by 72.79 and 48.70 percent, respectively. Stability analysis was performed to identify IL-47, IL-51, and IL-259 as the most stable ILs in stage-III. Tolerant ILs with specific and wider adaptability identified in this study can serve as the potential resources to understand the genetic basis of heat and drought stress tolerance in wheat and they can also be utilized in developing high-yielding wheat cultivars with enhanced heat and drought stress tolerance.

Research on Multi-Stage Post-Occupancy Evaluation Framework of Community Comprehensive Elderly Care Service Facilities under the Public-Private Partnership Mode—A Case Study of China

The key to whether elderly individuals in the community can enjoy their later years peacefully lies in the service capabilities of community comprehensive elderly care service facilities (CCECSF) under the Public-Private Partnership (PPP) mode. To maintain a high level of service capability in community comprehensive elderly care service facilities under PPP mode, scientific evaluation of the effectiveness of these facilities is equally crucial. This article first constructs a post-occupancy evaluation index system of community comprehensive elderly care service facilities under PPP mode that includes three evaluation attributes and fifteen evaluation criteria based on the Chinese culture and lifestyle habits. Regarding the issue of direct users being unable to directly participate in evaluations, the uncertainty in evaluation information, and the volatility of evaluation results, a multi-stage post-occupancy evaluation model is constructed based on probabilistic linguistic term set, TOPSIS model and multi-stage decision theory. The above post-occupancy evaluation index system and evaluation model together constitute a multi-stage post-occupancy evaluation framework for community comprehensive elderly care service facilities under PPP mode. The outcomes of the case study indicate that the post-occupancy evaluation index system can offer a scientifically guided approach for evaluating the service level of community comprehensive elderly care service facilities under the PPP mode; meanwhile, the multi-stage evaluation model can enable direct user participation in the post-evaluation of facility usage and improve the robustness and reduce the fluctuation of the evaluation results, so as to improve the scientificity of the evaluation results.

Prevention of eating disorders: 2023 in review

ABSTRACT This review of 16 prevention-related publications in Eating Disorders during 2022 is framed by three models: (1) Mental Health Intervention Spectrum: health promotion → types of prevention → case identification/referral → treatment; (2) the prevention cycle: rationale and theory, shaped by critical reviews → clarifying risk and protective factors → program innovation and feasibility studies → efficacy and effectiveness research → program dissemination; and (3) definitions of and links between disordered eating (DE) and eating disorders (EDs). Seven articles fell into the category of prevention rationale (including screening studies) and relevant reviews, while nine articles addressed correlates of/risk factors (RFs) for various aspects of DE and EDs. One implication of the 16 articles reviewed is that RF research toward construction of selective and indicated prevention programs for an expanding array of diverse at-risk groups needs to address, from a nuanced, intersectional framework, a broad range of factors beyond negative body image and internalization of beauty ideals. Another implication is that, to expand and improve current and forthcoming prevention programs, and to shape effective advocacy for prevention-oriented social policy, the field in general and Eating Disorders in particular need more scholarship in the form of critical reviews and meta-analyses; protective factor research; prevention program development and multi-stage evaluation; and case studies of multi-step activism at the local, state (province, region), and national levels.

A Program Evaluation Study for Measurement and Evaluation Course in Distance Education

This study aims to evaluate the online measurement and evaluation course in teacher training programs during the COVID-19 process. In the study, we sought answers to two primary research questions: What are the opinions of teachers and school administrators regarding their measurement and evaluation competencies? Does the online "measurement and evaluation" course have the qualities of an effective program in the "antecedents, transactions, and outcomes" dimension? We structured the research into two phases within a multistage evaluation design framework. The findings show that there were problems and positive aspects in all dimensions of the program. For example, adapting teacher training programs developed before COVID-19 to distance education processes was challenging. In distance education, some practices contradict the modern teaching and assessment approach. Such problems were reflected in teachers' acquisition of measurement and evaluation competencies. The achievement test we applied to the observed groups also confirmed these findings. For this reason, responsible organizations should not ignore the fact that we cannot renounce distance education. During program development, they should reconsider how the teachers will acquire measurement and evaluation competencies and how we will measure and evaluate in distance education.

Optimizing yeast strain selection for mulberry wine fermentation: a performance-based approach

This study focused on identifying the optimal yeast strain for Dechang mulberry wine fermentation blended through a multi-stage evaluation process using five commercial yeasts. Initially, the Durham tube fermentation method and weight-based analysis were employed for initial screening. Subsequently, a secondary evaluation involving physical, chemical, and sensory assessments was conducted. The final stage assessed yeast tolerance to ethanol and sulfur dioxide (SO2), and the wine’s volatile compounds were analyzed using gas chromatography-mass spectrometry. The L13 yeast strain emerged as superior, demonstrating efficient fermentation initiation, rapid primary fermentation, and production of a desirable wine profile, including optimal sugar, acid, and alcohol levels. Notably, the L13 yeast strain showed resilience, tolerating up to 11% ethanol and 170-mg/L SO2 within 7 days, and contributed to a rich aromatic profile with 23 volatile compounds, including 13 esters. These attributes render the L13 strain particularly suitable for producing mulberry wine with robust fermentation characteristics and a complex aroma, enhancing both quality and sensory appeal of the final product.

Differentiation of Salivary Gland and Salivary Gland Tumor Tissue via Raman Imaging Combined with Multivariate Data Analysis.

Salivary gland tumors (SGTs) are a relevant, highly diverse subgroup of head and neck tumors whose entity determination can be difficult. Confocal Raman imaging in combination with multivariate data analysis may possibly support their correct classification. For the analysis of the translational potential of Raman imaging in SGT determination, a multi-stage evaluation process is necessary. By measuring a sample set of Warthin tumor, pleomorphic adenoma and non-tumor salivary gland tissue, Raman data were obtained and a thorough Raman band analysis was performed. This evaluation revealed highly overlapping Raman patterns with only minor spectral differences. Consequently, a principal component analysis (PCA) was calculated and further combined with a discriminant analysis (DA) to enable the best possible distinction. The PCA-DA model was characterized by accuracy, sensitivity, selectivity and precision values above 90% and validated by predicting model-unknown Raman spectra, of which 93% were classified correctly. Thus, we state our PCA-DA to be suitable for parotid tumor and non-salivary salivary gland tissue discrimination and prediction. For evaluation of the translational potential, further validation steps are necessary.

Drug-induced cardiac toxicity and adverse drug reactions, a narrative review

Drug-induced cardiotoxicity is a primary concern in both drug development and clinical practice. Although the heart is not a common target for adverse drug reactions, some drugs still cause various adverse cardiac events, with sometimes severe consequences. Direct cardiac toxicity encompasses functional and structural changes of the cardiovascular system due to possible exposure to medicines. This phenomenon extends beyond cardiovascular drugs to include non-cardiovascular drugs including anticancer drugs such as tyrosine kinase inhibitors, anthracyclines and immune checkpoint inhibitors (ICIs), as well as various antipsychotics, venlafaxine, and even some antibiotics (such as macrolides). Cardiac ADRs comprise an array of effects, ranging from heart failure and myocardial ischemia to valvular disease, thrombosis, myocarditis, pericarditis, arrhythmias, and conduction abnormalities. The underlying mechanisms may include disturbances of ionic processes, induction of cellular damage via impaired mitochondrial function, and even hypercoagulability. To mitigate the impact of drug-induced cardiotoxicity, multi-stage evaluation guidelines have been established, following the International Council for Harmonisation of Technical Requirements for Pharmaceuticals for Human Use (ICH) guidelines for in vitro and in vivo testing. Despite preclinical safeguards, post-marketing surveillance remains critical, as certain cardiotoxic drugs may escape initial scrutiny. Indeed, historical data show that cardiovascular ADRs contribute to almost 10% of market withdrawals. The impact of drug-induced cardiotoxicity on cardiac issues, particularly heart failure, is often underestimated, with incidence rates ranging from 11.0% to over 20.0%. We here comprehensively examine different patterns of drug-induced cardiotoxicity, highlighting current concerns and emerging pharmacovigilance signals. Understanding the underlying mechanisms and the associated risk factors is critical in order to promptly identify, effectively manage, and proactively prevent drug-induced cardiac adverse events. Collaborative efforts between physicians and cardiologists, coupled with thorough assessment and close monitoring, are essential to ensuring patient safety in the face of potential drug-induced cardiotoxicity.

Evaluation of Incremental Validity of Casper in Predicting Program and National Licensure Performance of Undergraduate Nursing Students: Protocol for a Mixed Methods Study.

Academic success has been the primary criterion for admission to many nursing programs. However, academic success as an admission criterion may have limited predictive value for success in noncognitive skills. Adding situational judgment tests, such as Casper, to admissions procedures may be one strategy to strengthen decisions and address the limited predictive value of academic admission criteria. In 2021, admissions processes were modified to include Casper based on concerns identified with noncognitive skills. This study aims to (1) assess the incremental validity of Casper scores in predicting nursing student performance at years 1, 2, 3, and 4 and on the National Council Licensing Examination (NCLEX) performance; and (2) examine faculty members' perceptions of student performance and influences related to communication, professionalism, empathy, and problem-solving. We will use a multistage evaluation mixed methods design with 5 phases. At the end of each year, students will complete questionnaires related to empathy and professionalism and have their performance assessed for communication and problem-solving in psychomotor laboratory sessions. The final phase will assess graduate performance on the NCLEX. Each phase also includes qualitative data collection (ie, focus groups with faculty members). The goal of the focus groups is to help explain the quantitative findings (explanatory phase) as well as inform data collection (eg, focus group questions) in the subsequent phase (exploratory sequence). All students enrolled in the first year of the nursing program in 2021 were asked to participate (n=290). Faculty will be asked to participate in the focus groups at the end of each year of the program. Hierarchical multiple regression will be conducted for each outcome of interest (eg, communication, professionalism, empathy, and problem-solving) to determine the extent to which scores on Casper with admission grades, compared to admission grades alone, predict nursing student performance at years 1-4 of the program and success on the national exam. Thematic analysis of focus group transcripts will be conducted using interpretive description. The quantitative and qualitative data will be integrated after each phase is complete and at the end of the study. This study was funded in September 2021, and data collection began in March 2022. Year 1 data collection and analysis are complete. Year 2 data collection is complete, and data analysis is in progress. At the end of the study, we will provide the results of a comprehensive analysis to determine the extent to which the addition of scores on Casper compared to admission grades alone predicts nursing student performance at years 1-4 of the program and on the NCLEX exam. RR1-10.2196/48672.

The multi-stage evaluation framework for low-carbon development level of rail transit under probabilistic linguistic environment

The scientific evaluation of the low-carbon development level of rail transits is an important prerequisite for their scientific low-carbon transformation, and how to scientifically evaluate it is a problem that needs to be studied. This article first constructs an evaluation index system that includes 4 evaluation attributes and 11 evaluation criteria based on the reality of low-carbon development in rail transit. Then, aiming at the uncertainty of evaluation information and the fluctuation of evaluation results in the evaluation of low-carbon development of rail transits, a multi-stage evaluation model is constructed based on probabilistic linguistic term set, TOPSIS model principle and multi-stage decision theory. The above evaluation index system and evaluation model together constitute a multi-stage evaluation framework for low carbon development level of rail transits. The results of the case study show that the evaluation index system can provide scientific guidance for the low-carbon development level evaluation of rail transits, and the multi-stage evaluation model can improve the robustness and reduce the fluctuation of the evaluation results, so as to improve the scientificity of the evaluation results.

Explaining the causes and effective interventions in academic failure from the perspective of conditional students in University of Medical Sciences: A qualitative study

Introduction: Due to the lack of information about the causes of academic failure of university students, as well as the lack of knowledge of effective interventions to prevent and reduce this problem, this qualitative study aims to explain the causes and effective interventions in academic failure from the perspective of conditional students at Hamadan University of Medical Sciences.
 Methods: This research was a qualitative study using descriptive phenomenology approach. The study population was conditional students who were selected through purposive sampling. Interviews with people were conducted in-person and in-depth according to their wishes. The time of each interview was 45 to 60 minutes. The information obtained from the interview was analyzed using the 7-step method of Kleiser. To increase the trust and scientific credibility of the results, Lincoln and Goba methods were used.
 Results: Data analysis led to the extraction of 6 classes as effective causes of academic failure, which included academic problems, physical and mental problems, looking to the future, financial problems, us ing technology, and family and social problems. Data analysis led to 4-story extraction as an effective intervention on academic failure, including academic intervention, reduction of physical and mental problems, family and social problems, and other interventions.
 Conclusion: It is useful to use interventions in the process of reducing academic dropout in students. Interventions such as proper nutrition, reducing the use of virtual space, the presence of a consultant and helping students in time management and planning, multi-stage evaluation according to the courses can be effective.

Facilitating skills transfer: a collaborative writing centre intervention for undergraduate Law students

Despite the ability to write being central to success in the legal profession, there is general consensus concerning the poor writing skills of law graduates. In an attempt to address these concerns, this paper reports on the joint effort of subject experts and writing centre practitioners to address law students’ legal writing skills early on in their law degree. The objective of the study was to evaluate the potential impact of a blended, subject-specific writing intervention designed to address first-year Law students’ academic essay writing skills in terms of structure, organisation and argumentation. A multistage evaluation design was adopted to measure the potential impact of the intervention by collecting qualitative and quantitative data at various stages to triangulate the findings of the study. The results showed a statistically significant improvement in the submissions of students who engaged fully in the various stages of the writing intervention. This study contributes to research that shows that by embedding writing development initiatives in disciplines which form part of disciplinary course assessment, higher education institutions might begin to make headway in meeting their obligation to ensure that students possess the key graduate attributes that are required to make a contribution to the workplace.

A process for CO2 capture and brine salinity reduction through reaction with potassium hydroxide: A multi-stage evaluation

Solvay and modified Solvay processes are facing a major challenge in reducing brine salinity to a level suitable for agriculture and industry. This challenge arises as a result of competing reactions and mixing limits between CO2 gas and brine. Another challenge is the high solubility of sodium bicarbonate (NaHCO3), which results in a low overall desalination efficiency. Previous studies established the effectiveness of a modified Solvay process based on potassium hydroxide (KOH). The first objective of this study is to evaluate a multi-stage treatment for a modified Solvay process on the basis of potassium hydroxide (KOH) to achieve an additional reduction in ion removal from high-salinity brines and an increase in CO2 capture as compared to previously obtained under optimal operating conditions. Three different methods were investigated. The first method evaluated the effectiveness of adding ammonium bicarbonate (NH4HCO3) in reducing the solubility of NaHCO3. Even though the Na+ and Cl− concentrations were reduced by 56.2% and 40%, respectively, the total CO2 uptake slightly improved by 1.2% (67.8 g CO2/1000 ml of treated brine). In the second method, the addition of extra KOH in subsequent stages was investigated to overcome the pH reduction observed in the first method. There was an ∼ 47.3% improvement in CO2 uptake from the first method. Furthermore, the percentages of Na+ and Cl− removal were increased to 65% and 64.5%, respectively. In the third method, the recovery of Ca2+ and Mg2+ was approximately 76.3% and 94.6%, respectively, following the pre-treatment step (filtration), followed by the same stages as in the second method. Reducing these ions decreased the competitive reactions and thus increased CO2 solubility and reactivity with KOH, resulting in higher cumulative CO2 uptake from all stages to 108.2 g CO2/1000 ml, which was 8.3% more than the second method. Additionally, solid products were characterized using scanning electron microscopy, X-ray diffraction, FTIR and Raman analysis. Finally, the dynamic behaviour of the reactor was evaluated using step changes in the inlet gas and liquid flow rate. The results are promising in terms of the reactor system's adaptability to large-scale processes.

Platforms and Prejudice: The Cycle of Racial Disparities on a Labor Platform

We examine a multistage evaluation process to understand the conditions under which racial minorities are at risk for disparate work outcomes using data from a platform-based skilled labor market for small business entrepreneurs. Analyzing various evaluative outcomes including job cancellations, ratings, and job allocation for nearly 100,000 jobs, we find that workers perceived as racial minorities (relative to white) receive significantly more cancellations, as well as more one-star ratings and fewer five-star ratings, even among top performers. Factors that reduce uncertainty, including worker quality, and both worker and customer experience, help attenuate the disparity in cancellations but not in ratings. Further, we demonstrate the cyclical nature of bias entrenchment and the interplay of bias with formal practices—ratings and cancellations are mutually reinforcing, and feed back into priority algorithmic work assignments. Our research illustrates the critical role that uncertainty plays in magnifying bias against racial minorities in labor market contexts and that the mechanism driving bias is a function of the evaluation stage. We contribute to the sociological literature on bias in labor market processes, status and inequality in organizations, and work precarity.

Perspective Projects Screening Model for Decision-makers at Administrative Level

The field of social innovation is developing rapidly all over the world, with new institutions, methods and activities. More systematic innovation methods are being applied to some of the most challenging social problems of our times. The main purpose of this paper is to present the designed decision-making model as a support for evaluation of social innovation projects using multiple criteria decision-making methods. First, the theoretical background and foundations of social innovation are described. The essence of evaluation approaches that can be used in this field as well as multi-stage evaluation processes have been discussed. This information is the basis for presenting the model for screening of social innovation projects. The considerations are completed with an indication of possible directions for further research on new instruments useful in evaluation processes of such projects. The logic and process of the decision-making model elaboration as well as the decision model itself can be used as a framework for managers facing decision-making problems with similar nature as innovation management concepts.

Safety evaluation of urban rail transit operation considering uncertainty and risk preference: A case study in China

Safety evaluation of urban rail transit (URT) operation can not only have a great impact on passenger travel options, but is also related to planning of urban development. The evaluation results of URT operational safety are important for transit operators and passengers. In this study, we develop an integrated multi-stage evaluation framework to assess URT operation from the perspective of safety, which considers information uncertainty of key influence factors (KIFs), and risk preference of decision-makers (DMs). Firstly, to identify and select KIFs, this study makes systematic analysis of impacts on URT operational safety from five aspects: passengers, management, equipment, environment, and disaster respectively. Vensim software is used to build a stock flow model based on system dynamics method, and a two-level index system for assessing URT operational safety is established. Secondly, DMs’ weights are specified based on interval valued triangular fuzzy (IVTF)-TOPSIS method, and IVTF-AHP-entropy is introduced to determine the combined weight of each indicator. Thirdly, an S-shaped utility function under IVTF environment is developed to get the ranking order of research objects, and operational safety levels are determined based on cloud model. Finally, Changsha subway network is selected as a case study to test our proposed evaluation framework, and some related suggestions for operators and managers have been put forward in the future.