Methodology In Practice Research Articles

SYNTAX Score Reproducibility and Variability Between Interventional Cardiologists, Core Laboratory Technicians, and Quantitative Coronary Measurements

In the Synergy between Percutaneous Coronary Intervention with Taxus and Cardiac Surgery (SYNTAX) trial, the SYNTAX score was useful in risk stratifying patients with complex coronary artery disease. The reproducibility of this score may affect its clinical utility. We therefore assessed SYNTAX score interobserver and intraobserver variability among a group of interventional cardiologists (ICs) and an experienced group of angiographic core laboratory (ACL) technicians. After basic training from the SYNTAX score website, 3 ICs and 4 ACL technicians, each working independently, assessed the SYNTAX score of 30 multivessel disease angiograms. The ICs then underwent an intensive training session with ACL technicians, after which the SYNTAX score from 50 additional angiograms were assessed independently by both groups. Interobserver Fleiss κ statistic values were determined. A third assessment was performed using quantitative coronary angiography (QCA). The ACL technician interobserver strength of agreement from both periods was substantial or greater (k=0.82; 95% CI [0.72, 1.00] and 0.84 [0.76, 1.00]) and not different than QCA. The IC interobserver agreement was initially estimated to be at least slight (k=0.33 [0.18, 0.44]), improving to substantial or greater after advanced training (k=0.76 [0.64, 1.00]). Despite advanced training, ICs underscored the number of lesions, bifurcations, and small-vessel disease (P<0.001), resulting in a lower score than ACL technicians (mean difference=7.5, P<0.001). Highly reproducible SYNTAX score measurements were quickly achieved by experienced ACL technicians. In contrast, agreement among ICs after the basic tutorial was initially poor but improved considerably after further training with the ACL, although differences still remained in interpretation of several lesion types. These findings have important implications for adoption of SYNTAX score methodology in routine practice and future clinical trials.

On the reproducibility of empirical software engineering studies based on data retrieved from development repositories

Among empirical software engineering studies, those based on data retrieved from development repositories (such as those of source code management, issue tracking or communication systems) are specially suitable for reproduction. However their reproducibility status can vary a lot, from easy to almost impossible to reproduce. This paper explores which elements can be considered to characterize the reproducibility of a study in this area, and how they can be analyzed to better understand the type of reproduction studies they enable or obstruct. One of the main results of this exploration is the need of a systematic approach to asses the reproducibility of a study, due to the complexity of the processes usually involved, and the many details to be taken into account. To address this need, a methodology for assessing the reproducibility of studies is also presented and discussed, as a tool to help to raise awareness about research reproducibility in this field. The application of the methodology in practice has shown how, even for papers aimed to be reproducible, a systematic analysis raises important aspects that render reproduction difficult or impossible. We also show how, by identifying elements and attributes related to reproducibility, it can be better understood which kind of reproduction can be done for a specific study, given the description of datasets, methodologies and parameters it uses.

Hybrid and Parallel Domain-Decomposition Methods Development to Enable Monte Carlo for Reactor Analyses

** This paper describes code and methods development at the Oak Ridge National Laboratory focused on enabling high-fidelity, large-scale reactor analyses with Monte Carlo (MC). Current state-of-the-art tools and methods used to perform “real” commercial reactor analyses have several undesirable features, the most significant of which is the non-rigorous spatial decomposition scheme. Monte Carlo methods, which allow detailed and accurate modeling of the full geometry and are considered the “gold standard” for radiation transport solutions, are playing an ever-increasing role in correcting and/or verifying the deterministic, multi-level spatial decomposition methodology in current practice. However, the prohibitive computational requirements associated with obtaining fully converged, system-wide solutions restrict the role of MC to benchmarking deterministic results at a limited number of state-points for a limited number of relevant quantities. The goal of this research is to change this paradigm by enabling direct use of MC for full-core reactor analyses. The most significant of the many technical challenges that must be overcome are the slow, non-uniform convergence of system-wide MC estimates and the memory requirements associated with detailed solutions throughout a reactor (problems involving hundreds of millions of different material and tally regions due to fuel irradiation, temperature distributions, and the needs associated with multi-physics code coupling). To address these challenges, our research has focused on the development and implementation of (1) a novel hybrid deterministic/MC method for determining high-precision fluxes throughout the problem space in k-eigenvalue problems and (2) an efficient MC domain-decomposition (DD) algorithm that partitions the problem phase space onto multiple processors for massively parallel systems, with statistical uncertainty estimation. The hybrid method development is based on an extension of the FW-CADIS method, which attempts to achieve uniform statistical uncertainty throughout a designated problem space. The MC DD development is being implemented in conjunction with the Denovo deterministic radiation transport package to have direct access to the 3-D, massively parallel discrete-ordinates solver (to support the hybrid method) and the associated parallel routines and structure. This paper describes the hybrid method, its implementation, and initial testing results for a realistic 2-D quarter core pressurized-water reactor model and also describes the MC DD algorithm and its implementation.

A hierarchical deployment of distributed product lifecycle management system in collaborative product development

This article proposes a novel methodology of distributed PLM platform deployment. It incorporates information technologies to support collaborative product development in a global enterprise with multiple distributed sites. The requirements of the enterprise are systematically analysed from the organisational, data, content and application views. The corresponding operational guidelines are provided for determining the hardware configuration integrated from the analysis results. A customised deployment plan that reflects the actual user needs is then generated to construct a cost-effective collaborative PLM platform. A case study is included to demonstrate the feasibility of the proposed methodology in practice.

Practices of robust design methodology in practice

PurposeThe purpose of this paper is to investigate whether a design of experiments application in a company that works with robust design management (RDM) reflects the principles and practices of RDM.Design/methodology/approachThe findings of this paper are based on an empirical study of a medium‐sized Swedish enterprise that develops and manufactures consumer products for domestic use and actively uses RDM. The study is comprised of an analysis of internal company documents, semi‐structured interviews and e‐mail correspondence.FindingsThe study reveals a gap between principles and tool use; a feasible tool is applied but in a suboptimal mode with a low contribution in terms of increased robustness. This gap could be bridged by practices that describe, on an activity‐based level, what needs to be done in order to fulfil the principles.Originality/valueThe results of this case explain the difficulties that companies face when trying to introduce RDM. It also provides insights into RDM implementation work at the company in question.

Synthetic training sets for the development of discriminant functions for the detection of volatile organic compounds from passive infrared remote sensing data

A novel synthetic data generation methodology is described for use in the development of pattern recognition classifiers that are employed for the automated detection of volatile organic compounds (VOCs) during infrared remote sensing measurements. The approach used is passive Fourier transform infrared spectrometry implemented in a downward-looking mode on an aircraft platform. A key issue in developing this methodology in practice is the need for example data that can be used to train the classifiers. To replace the time-consuming and costly collection of training data in the field, this work implements a strategy for taking laboratory analyte spectra and superimposing them on background spectra collected from the air. The resulting synthetic spectra can be used to train the classifiers. This methodology is tested by developing classifiers for ethanol and methanol, two prevalent VOCs in wide industrial use. The classifiers are successfully tested with data collected from the aircraft during controlled releases of ethanol and during a methanol release from an industrial facility. For both ethanol and methanol, missed detections in the aircraft data are in the range of 4 to 5%, with false positive detections ranging from 0.1 to 0.3%.

A conceptual framework for energy technology sustainability assessment

Technology assessment has changed in nature over the last four decades from an analytical tool for technology evaluation, which depends heavily on quantitative and qualitative modelling methodologies, into a strategic planning tool for policy making concerning acceptable new technologies, which depends on participative policy problem analysis. The goal of technology assessment today is to generate policy options for solutions of organizational and societal problems, which, at the operational level, utilize new technologies that are publicly acceptable, that is, viable policy options. This study focuses on the development of a framework that incorporates a technology assessment approach, namely, system dynamics, within the broader scope of technology development for sustainability. The framework, termed system approach to technology sustainability assessment ( SATSA), integrates three key elements: technology development, sustainable development, and dynamic systems approach. The article then demonstrates the framework of incorporating the system dynamics methodology in energy technology assessment theory and practice within the context of sustainable development. The framework provides for technology sustainability assessment, which, in turn, can guide the promotion of sustainable energy technologies at a policy level. In addition, it can assist technology developers in understanding the potential impacts of a technology, hence enabling them to reduce technology transfer risks.

The role of spectrophotometry in the diagnosis of melanoma

BackgroundSpectrophotometry (SPT) could represent a promising technique for the diagnosis of cutaneous melanoma (CM) at earlier stages of the disease. Starting from our experience, we further assessed the role of SPT in CM early detection.MethodsDuring a health campaign for malignant melanoma at National Cancer Institute of Naples, we identified a subset of 54 lesions to be addressed to surgical excision and histological examination. Before surgery, all patients were investigated by clinical and epiluminescence microscopy (ELM) screenings; selected lesions underwent spectrophotometer analysis. For SPT, we used a video spectrophotometer imaging system (Spectroshade® MHT S.p.A., Verona, Italy).ResultsAmong the 54 patients harbouring cutaneous pigmented lesions, we performed comparison between results from the SPT screening and the histological diagnoses as well as evaluation of both sensitivity and specificity in detecting CM using either SPT or conventional approaches. For all pigmented lesions, agreement between histology and SPT classification was 57.4%. The sensitivity and specificity of SPT in detecting melanoma were 66.6% and 76.2%, respectively.ConclusionsAlthough SPT is still considered as a valuable diagnostic tool for CM, its low accuracy, sensitivity, and specificity represent the main hamper for the introduction of such a methodology in clinical practice. Dermoscopy remains the best diagnostic tool for the preoperative diagnosis of pigmented skin lesions.

Care pathways: some social scientific observations on the field

In an earlier companion paper published in the journal, I drew on an ethnographic analysis of the care pathway field to argue that the growing popularity of pathway methodology can be explained, in part, by its effectiveness in aligning clinical and management interests in offering a single solution to shared health service problems. This breadth of appeal disguises tensions between clinical and management agenda which creates challenges in inscribing this multiplicity of interests into the pathway design and implementing the methodology in practice. This helps to explain the challenges of pathway development and implementation and the range of interventions to which the term ‘pathway’ is applied. In this paper I consider how pathway leaders have responded to these concerns and offer an alternative response, informed by social science.

A natural resource valuation tool for assisting natural resource management

PurposeThe paper's purpose is to investigate the opportunities for better integration of environmental valuation (EV) methodology into the natural resource management (NRM) decision‐making process in the context of NRM practices in South Australia and to offer a practical valuation tool to the NRM agencies for assisting the NRM decision‐making process.Design/methodology/approachThis research examines the theoretical approach to EV methodology in an attempt to reduce certain limitations of the methodology. Data for this project were collected through interviews with various South Australian state NRM authorities. Both theoretical and empirical findings led to the development of a natural resource valuation (NRV) tool based on a modification of the contingent valuation (CV) technique.FindingsThe data obtained indicate a range of reasons for under‐utilisation of EV methodology in NRM practice in South Australia such as the controversial nature of the methodology and low level of awareness among NRM practitioners about the benefits of undertaking EV studies. These findings are addressed by the NRV tool aimed at promoting EV in NRM community consultation practices.Originality/valueThe results described in the paper are of value to NRM practitioners in offering a new valuation tool for better‐informed decision making. As a theoretical assessment of certain aspects of EV methodology, this research is of value to the academic community.

Congruence and dissonance between micro-teaching and macro- teaching

All the faculties of education in Turkey follow the structured programme prepared by the Higher Institute of Education and teacher trainees require to take many classes on methodology in language teaching and practice in the class before they are sent to the schools of Ministry of Education. The literature on supervisory lesson observation during initial teacher education implies the full preparation of the teacher candidates and tends to focus on the supposedly ideal lesson plans checked and supervised by mentors, tutors or supervisors (e.g. Cameron-Jones & O’Hara, 1995; Saunders et al., 1995; Rikard & Veal, 1996; Geen, 2001; Hopper, 2001; Lombardi, 2001; Hobson, 2002) and on discussion in the post-lesson conference (Waite, 1992; Parkinson & Davies, 1994; Roberts, 1992, 1994; Williams et al., 1998; John & Gilchrist, 1999; John, 2001). For this purpose, a qualitative case study method is followed. The participants are 100 senior year students at The English Language Teacher Training Department, Dokuz Eylul University, Izmir, Turkey. The data are analysed by seeking patterns and themes in relation to each research question. The participants believe that a close connection between the course materials and practical application in real classrooms do not always exist. They also state that they do not have enough opportunities for micro-teaching and practice before going to secondary schools for the Practicum class and the main problems they encounter are qualitatively classified and analysed.

Diagnostic reference levels as a quality assurance tool

AbstractThe objective of diagnostic reference levels (DRL) in radiology is to assist in the optimisation of radiation dose to patients, while maintaining diagnostic image quality, and to detect unusually high doses that do not contribute significantly to the clinical outcome of a medical imaging examination. DRL have been in existence overseas for more than a decade and its influence has contributed to a steady decline in dose for general radiography and fluoroscopic procedures. High dose modalities such as CT and interventional procedures are increasing dramatically both locally and internationally resulting in the unwanted outcome of a significant increase in population cumulative effective dose. This calls for urgent dose reduction and dose constraint measures. Utilising DRL is one method of optimising patient dose. Some local and international DRL dose levels for some common radiographic, interventional and CT examinations are presented as a suggestion for the application of this methodology in Australian radiology practice.

State space models for estimating and forecasting fertility

Abstract We introduce multivariate state space models for estimating and forecasting fertility rates that are dynamic alternatives to logistic representations for fixed time points. Strategies are provided for the Kalman filter and for quasi-Newton algorithm initialization, that assure the convergence of the iterative fitting process. The broad impact of the new methodology in practice is shown using data series from Spain, Sweden and Australia, and by comparing the results with a recent approach based on functional data analysis and also with official forecasts. Very satisfactory short- and medium-term forecasts are obtained. Besides this, the new modeling proposal provides practitioners with several suitable interpretative tools, and the application here is an interesting example of the usefulness of the state space representation in modelling real multivariate processes.

Between the Ideal and the Real: Using Ethnography as a Way of Extending Our Language of Change

The following paper is a critical examination of participatory action research in practice. By looking at two different narratives of this methodology in practice the aim of the paper is to initiate a discussion around the ways in which we1 talk about participatory action research—our narratives of participatory action research—and how these forms of expression constrain our theorising of people, interaction, and change. The first narrative discussed follows the conventions of action research. I describe this narrative as a formal narrative that highlights the ideal dimensions of participatory action research. The second narrative follows ethnographic conventions. I describe this narrative as an informal narrative that highlights the real (or lived experience in the language of ethnography) dimensions of participatory action research. In comparing and contrasting the two narratives, I aim to demonstrate the narrative conventions that govern change experiences. I conclude by suggesting that on the one hand we need to maintain a tension between the ideal and the real but at the same time acknowledge that sometimes narrative conventions of the ideal are difficult to break away from. 1By “we,” I am referring to researchers and practitioners, that is, experts of action research.

The use of mycotoxin methodology in practice: a need for harmonization

Background In the EU, sampling and analysis for the official control of the levels of mycotoxins in foodstuffs should be performed in accordance with the methods and criteria set out in Commission Regulation 401/2006. For each mycotoxin, the values of recovery, repeatability and reproducibility of the analytical method selected by each laboratory must fall within the range of acceptability as prescribed in the Regulation. Aims Carry out a survey on current practices concerning the use and application of mycotoxin test methods for what are considered to be the most current commercially significant mycotoxins. Materials and Methods Nineteen control, commercial and research laboratories from 12 countries (United Kingdom, Italy, Belgium, Spain, Germany, The Netherlands, Bulgaria, Hungary, Greece, Turkey, New Zealand and China) participated in a survey of current practices concerning the use and application of methods for the determination of the principal mycotoxins found in foods and subject to regulatory control: [aflatoxins (AFs: AFB1, AFB2, AFG1, AFG2), aflatoxin M1 (AFM1) fumonisins (FBs: FB1, FB2), ochratoxin A (OTA), deoxynivalenol (DON), patulin (PAT), zearalenone (ZEA), and T-2 and HT-2 toxins]. Results and Discussion Fourteen of the laboratories surveyed were accredited to ISO 17025:2005 and the accreditation paralleled participation in proficiency testing schemes such as FAPAS®. Most of the laboratories declared that they received laboratory samples weighing between 0.004–1 kg. The number and types of food matrices analysed for each mycotoxin or group of mycotoxins varied consistently between mycotoxins, laboratories and countries. In general the highest number of food matrices capable of being assessed for a particular mycotoxin was for OTA followed - in decreasing order - by AFs, DON, ZEA, T-2/HT-2 toxins, FBs, AFM1 and PAT. Analysis for OTA, AFs, PAT, ZEA, DON, FBs, T-2/HT-2 toxins and AFM1, were performed in 95%, 84%, 74%, 74%, 63%, 58%, 58% and 53% of the laboratories, respectively. Most laboratories stated that they used HPLC coupled with either a fluorometer, ultraviolet or mass spectrometric (MS) detectors for detection and quantification of mycotoxins. Only one laboratory used GC/MS for analysis of T-2 and HT-2 toxins whereas two laboratories used TLC based methods for the determination of all mycotoxins except fumonisins. The use of LC-MS methodology by eight laboratories is remarkable because LC/MS is not an official method for mycotoxins within a CEN or AOAC context. Some mycotoxins are not amenable to all detection techniques reported above. ELISA kits were used in three laboratories for the analysis of AFs, OTA, ZEA, DON, FBs and/or T-2/HT-2 toxins. Several other test kits were used in one laboratory for the determination of OTA (six different test kits) and DON (eight different test kits). Six different definitions of limit of detection (LOD) and nine different definitions of limit of quantification (LOQ) have been reported by participating laboratories with the signal/noise ratio being the most popular (used by 40% of laboratories). In some cases the values of LOD, LOQ and measurement uncertainty for the same mycotoxin varied from laboratory to laboratory. In particular, a large variability of measurement uncertainty was noted that was probably due to non-harmonized interpretation of the term. Conclusion This survey suggests that the primary issues needing to be harmonized are: accreditation needed, appropriate size of laboratory sample, guidelines on the most convenient analytical method for each combination of mycotoxins/matrix, use of method validated through a collaborative study, participation in proficiency testing, use of reference/certified materials/standard solutions, use of the same definition/calculation for LOD, LOQ, recovery and measurement uncertainty.

Joint vehicle assembly‐routing problems: An integrated modeling and optimization approach

AbstractThis article examines logistical systems where it is desirable to appropriately ascertain the joint composition of the sequences of vehicles that are to be physically connected along with determining their delivery routes. Such assembly‐routing problems occur in the truck manufacturing industry, for example, where combinations of trucks to be delivered to dealerships are composed and are subsequently dispatched via appropriately optimized delivery routes, which are in turn restricted by the particular sequence in which the trucks are connected. A similar structure is exhibited in the business of shipping goods via boat‐towed barges along inland waterways, or via trains through railroad networks. We present a novel unifying model and a column generation‐based optimization approach for this challenging class of joint vehicle assembly‐routing problems. In addition, we suggest several extensions to accommodate particular industrial settings where assembly sequence‐dependent delivery routes are necessary, as well as those where driver‐ and equipment‐based restrictions are imposed. Computational experience is provided using realistic data from a case‐study involving a major truck manufacturing company to demonstrate the applicability of the proposed methodology in practice. © 2008 Wiley Periodicals, Inc. NETWORKS, 2009

Revisiting the Performance Profile Technique: Theoretical Underpinnings and Application

The performance profile technique (Butler, 1989, 1991), which stems from a personal construct psychology (PCP; Kelly, 1955/1991) framework, has become a useful methodology for identifying and understanding an athlete’s perceived need for areas of improvement. Despite the popularity of this technique, current descriptions and practices fail to appreciate key tenets of PCP which offer a greater insight into one’s perspective. Accordingly, the purposes of this paper are to revisit the performance profile technique and describe an extension of its current form by drawing on these key PCP tenets as well as providing an example of the revised methodology in practice. Following a brief overview of PCP, we outline two key tenets of this theoretical framework that have guided the revised version of the performance profile technique presented here. We conclude with a case example of the new methodology in practice using an Australian footballer’s perception of mental toughness.

Real-Time 3-Dimensional Echocardiography

One of the most significant developments of the last decade in ultrasound imaging of the heart was the evolution of 3-dimensional (3D) imaging from slow and labor-intense offline reconstruction to real-time volumetric imaging. This imaging modality provides valuable clinical information that empowers echocardiographers with new levels of confidence in the diagnosis of heart disease. We have previously described the technological milestones in the development of real-time 3D echocardiographic (RT3DE) imaging and its major advantages over conventional 2-dimensional echocardiography (2DE) and reviewed the published literature that supported the use of this new methodology in clinical practice.1 Since 2006, the growing availability of RT3DE technology, its ease of use, and its multiple attractive features have sparked significant interest in the research community, resulting in a large number of publications, most of which have endorsed RT3DE imaging for clinical use by demonstrating its unique capabilities in different scenarios. In parallel, the clinical acceptance of this new tool has broadened significantly. The most recent clinically significant addition is matrix-array transesophageal echocardiography (TEE), which provides images of unprecedented quality that aid surgeons and interventional cardiologists in planning and guiding procedures and evaluating their outcomes. The purpose of the present article is to review the most recent RT3DE literature and provide readers with an update on the latest developments and the current status of this noninvasive imaging tool. Because different potential applications of RT3DE imaging have been explored to various extents, they are described here separately, and each is discussed with an emphasis on the scientifically established facts, along with the known stumbling blocks and difficulties. A firmly established advantage of 3D imaging over cross-sectional slices of the heart is the improvement in the accuracy of the evaluation of left ventricular (LV) volumes and ejection fraction (EF) by eliminating the need for geometric modeling, which …

Squatting at the Digital Campfire -Researching the Open Source Software Community

This paper describes an internet-mediated netnography of the open source software (OSS) community. A brief history of OSS is presented, along with a discussion of the defining characteristics of the phenomenon. A theoretical rationale for the method is then offered and several unique features detailed. The evolution of the methodology in practice is described and salient lessons highlighted. In addition to gathering a large volume of rich data as intended, early phases of the implementation of this method produced a number of unanticipated but significant findings. The paper concludes by summarising the key methodological considerations for conducting a phenomenology of a true online community

Quantitative Imaging of Musculoskeletal Tissue

Quantitative imaging of musculoskeletal tissue, including radiography, computed tomography (CT), and magnetic resonance imaging (MRI), has become the essential methodology in clinical practice for diagnosis and monitoring of various musculoskeletal conditions. Furthermore, quantitative imaging technologies have become indispensable for research and development in diseases of the human skeleton. Standardized methods of image analysis have been developed through the years to quantify measurements on bone and cartilage with high precision and accuracy. Key areas of musculoskeletal disease where quantitative imaging is currently employed are osteoporosis and arthritis.