Credibility Of Simulation Results Research Articles

Computer Modeling of Diabetes and Its Transparency: A Report on the Eighth Mount Hood Challenge

ObjectivesThe Eighth Mount Hood Challenge (held in St. Gallen, Switzerland, in September 2016) evaluated the transparency of model input documentation from two published health economics studies and developed guidelines for improving transparency in the reporting of input data underlying model-based economic analyses in diabetes. MethodsParticipating modeling groups were asked to reproduce the results of two published studies using the input data described in those articles. Gaps in input data were filled with assumptions reported by the modeling groups. Goodness of fit between the results reported in the target studies and the groups’ replicated outputs was evaluated using the slope of linear regression line and the coefficient of determination (R2). After a general discussion of the results, a diabetes-specific checklist for the transparency of model input was developed. ResultsSeven groups participated in the transparency challenge. The reporting of key model input parameters in the two studies, including the baseline characteristics of simulated patients, treatment effect and treatment intensification threshold assumptions, treatment effect evolution, prediction of complications and costs data, was inadequately transparent (and often missing altogether). Not surprisingly, goodness of fit was better for the study that reported its input data with more transparency. To improve the transparency in diabetes modeling, the Diabetes Modeling Input Checklist listing the minimal input data required for reproducibility in most diabetes modeling applications was developed. ConclusionsTransparency of diabetes model inputs is important to the reproducibility and credibility of simulation results. In the Eighth Mount Hood Challenge, the Diabetes Modeling Input Checklist was developed with the goal of improving the transparency of input data reporting and reproducibility of diabetes simulation model results.

An Analysis of the Evaluation Methods for Thermal Transmittance of Curtain Wall System Based on Simulators

With the window rating system being enforced, window companies are required to assign window ratings to their products. As the window ratings is based on the experimental results of fenestration, they are required to spend a lot of time and money conducting laboratory tests in order to assign window ratings to all their products. Through the window performance evaluation system using simulation, the thermal transmittance of products calculated based on numerical simulation can be used in place of experimental results to obtain the window rating. To ensure the credibility of simulation results, it is necessary to use the correct evaluation methods and primary information derived from in use practice should be available for the numerical simulation. The purpose of this paper is to investigate the evaluation methods that the simulator actually uses for the thermal performance of fenestration in WINDOW/THERM. The evaluation methods used by twenty-one simulators were investigated using primary evaluation methods for numerical simulation as the criteria. This study found that most of the simulation results were not trustworthy even though they were similar to experimental results because the evaluation methods used by simulators are incorrect. Furthermore, to enhance the credibility of simulation results, the simulator should be provided with the detailed information used in practice related to the evaluation performance of numerical simulation.

A Study on Effects of Gear Backlash on Differential Vibration

Based on UG and Automatic Dynamic Analysis of Mechanical System (ADAMS), the 3D model of differential was constructed and the real-time dynamic simulation of differential was achieved. The effects of gear backlash between half axle gears and planetary gears on the vibration of differential are studied. To increase the credibility of simulation results , the contact forces between half axle gears and planetary gears were calculated based on the Hertz elasticity impact theory.