Optimal Data Quality Research Articles

Autonomous Shipborne In Situ Reflectance Data in Optically Complex Coastal Waters: A Case Study of the Salish Sea, Canada

Present limitations on using satellite imagery to derive accurate chlorophyll concentrations and phytoplankton functional types arise from insufficient in situ measurements to validate the satellite reflectance, Rrs0+. We installed a set of hyperspectral radiometers with autonomous solar tracking capability, collectively named SAS Solar Tracker (Satlantic Inc./Sea-Bird), on top of a commercial ferry, to measure the in situ reflectance as the ferry crosses the Salish Sea, Canada. We describe the SAS Solar Tracker installation procedure, which enables a clear view of the sea surface and minimizes the interference caused by the ship superstructure. Corrections for residual ship superstructure perturbations and non-nadir-viewing geometry are applied during data processing to ensure optimal data quality. It is found that the ship superstructure perturbation correction decreased the overall Rrs0+ by 0.00055 sr−1, based on a black-pixel assumption for the infrared band of the lowest acquired turbid water. The BRDF correction using the inherent optical properties approach lowered the spectral signal by ∼5–10%, depending on the wavelength. Data quality was evaluated according to a quality assurance method considering spectral shape similarity, and ∼92% of the acquired reflectance data matched well against the global database, indicating high quality.

An Assessment of Geophysical Survey Techniques for Characterising the Subsurface Around Glacier Margins, and Recommendations for Future Applications

Geophysical surveys provide an efficient and non-invasive means of studying subsurface conditions in numerous sedimentary settings. In this study, we explore the application of three geophysical methods to a proglacial environment, namely ground penetrating radar (GPR), seismic refraction and multi-channel analysis of surface waves (MASW). We apply these geophysical methods to three glacial landforms with contrasting morphologies and sedimentary characteristics, and we use the various responses to assess the applicability and limitations of each method for these proglacial targets. Our analysis shows that GPR and seismic (refraction and MASW) techniques can provide spatially extensive information on the internal architecture and composition of moraines, but careful survey designs are required to optimise data quality in these geologically complex environments. Based on our findings, we define a number of recommendations and a potential workflow to guide future geophysical investigations in analogous settings. We recommend the initial use of GPR in future studies of proglacial environments to inform (a) seismic survey design and (b) the selection of seismic interpretation techniques. We show the benefits of using multiple GPR antenna frequencies (e.g., 25 and 100 MHz) to provide decimetre scale imaging in the near surface (e.g., < 15 m) while also enabling signal penetration to targets at up to ∼40 m depth (e.g., bedrock). This strategy helps to circumvent changes in radar signal penetration resulting from variations in substrate conductivity or abundant scatterers. Our study also demonstrates the importance of combining multiple geophysical methods together with ground-truthing through sedimentological observations to reduce ambiguity in interpretations. Implementing our recommendations will improve geophysical survey practice in the field of glacial geology and allow geophysical methods to play an increasing role in the interpretation of glacial landforms and sediments.

Editors’ Note and Prologue

Editors’ Note and Prologue

A massive 7T fMRI dataset to bridge cognitive neuroscience and artificial intelligence.

Extensive sampling of neural activity during rich cognitive phenomena is critical for robust understanding of brain function. Here we present the Natural Scenes Dataset (NSD), in which high-resolution functional magnetic resonance imaging responses to tens of thousands of richly annotated natural scenes were measured while participants performed a continuous recognition task. To optimize data quality, we developed and applied novel estimation and denoising techniques. Simple visual inspections of the NSD data reveal clear representational transformations along the ventral visual pathway. Further exemplifying the inferential power of the dataset, we used NSD to build and train deep neural network models that predict brain activity more accurately than state-of-the-art models from computer vision. NSD also includes substantial resting-state and diffusion data, enabling network neuroscience perspectives to constrain and enhance models of perception and memory. Given its unprecedented scale, quality and breadth, NSD opens new avenues of inquiry in cognitive neuroscience and artificial intelligence.

Challenging issues of integrity and identity of participants in non-synchronous online qualitative methods

Qualitative data collection is increasingly occurring online, with data collection methods often lacking the synchronous contact between researchers and participants present in more traditional methods of qualitative data collection such as face-to-face interviews. Despite numerous benefits of non-synchronous online methods of qualitative data collection, such methods also pose unique challenges concerning participant eligibility and data quality in the qualitative domain. Due to a longer tradition of conducting non-synchronous quantitative online data collection, researchers have discussed issues related to data quality for use within quantitative research, and developed techniques to address such issues. However, such discussions have not taken place within qualitative research and due to the differences in types of data and theoretical underpinnings, only some of the techniques developed in quantitative research can be appropriately applied in qualitative research. In this paper, we address this knowledge gap by providing an important ‘how to guide’, presenting techniques to help address threats to data quality and integrity in non-synchronous online qualitative research. We start by outlining techniques developed for use in quantitative research that can be appropriately transferred to qualitative paradigms, before proposing techniques to manage challenges faced specifically by non-synchronous online qualitative research. We go on to discuss some of the potential pitfalls which can prevent the implementation of these techniques and how to overcome them. Finally, we urge researchers to be transparent about the techniques they implement to optimise data quality and to adopt a proactive rather than reactive approach to maximising data quality in qualitative research studies.

Considerations for conducting and reporting digitally supported cognitive interviews with children and adults

BackgroundCognitive interviewing is a well-established qualitative method used to develop and refine PRO measures. A range of digital technologies including phone, web conferencing, and electronic survey platforms can be leveraged to support the conduct of cognitive interviewing in both children and adults. These technologies offer a potential solution to enrolling underrepresented populations, including those with rare conditions, functional limitations and geographic or socioeconomic barriers. In the aftermath of the COVID-19 pandemic, the use of digital technologies for qualitative interviewing will remain essential. However, there is limited guidance about adapting cognitive interviewing procedures to allow for remote data capture, especially with children.MethodsSynthesizing the literature and our research experiences during the COVID-19 pandemic, we examine considerations for implementing digitally supported cognitive interviews with children, adolescents, and adults. We offer recommendations to optimize data quality and empirical rigor and illustrate the application of these recommendations in an ongoing cognitive interviewing study to develop and refine a new pediatric PRO measure.ResultsGood research practices must address participant and researcher preparation for study-related procedures and should anticipate and pre-emptively manage technological barriers. Field notes should detail interview context, audio/video cues, and any impact of technological difficulties on data quality. The approaches we recommend have been tested in an ongoing cognitive interviewing study that is enrolling children/adolescents with cGVHD ages 5–17 and their caregivers [NCT 04044365]. The combined use of telephone and videoconferencing to conduct cognitive interviews remotely is feasible and acceptable and yields meaningful data to improve the content validity of our new PRO measure of cGVHD symptom bother.ConclusionDigitally supported cognitive interviewing procedures will be increasingly employed. Remote data collection can accelerate accrual, particularly in multi-site studies, and may allow for interviewer personnel and data management to be centralized within a coordinating center, thus conserving resources. Research is needed to further test and refine techniques for remote cognitive interviewing, particularly in traditionally underrepresented populations, including children and non-English speakers. Expansion of international standards to address digitally supported remote qualitative data capture appears warranted.

The value of increased spatial resolution of pesticide usage data for assessing risk to endangered species

AbstractDecision makers often cite data quality as a limitation in environmental management. Value of information approaches evaluate the benefit of new data collection for management outcomes. Pesticide exposure risk assessment for endangered species is one context where data limitations may affect decisions and a value of information type approach could be useful for identifying optimal data quality and resolution. Under the U.S. Federal Insecticide, Fungicide and Rodenticide Act, the U.S. Environmental Protection Agency (EPA) is responsible for registering pesticides before they can be sold and regularly reviewing pesticides. Section 7 of the Endangered Species Act requires that the EPA consider potential impacts of pesticides to listed endangered species and critical habitats in this process, and for the Services—U.S. Fish and Wildlife Service and National Marine Fisheries Service—to complete a formal Section 7 consultation if the EPA deems it necessary. The current process is time‐intensive, lacks transparency and confidence among stakeholders, and leaves hundreds of unreviewed pesticides on the market. Increasing the resolution of pesticide usage data could address these concerns by improving estimated overlaps between species ranges and pesticide usage. Thus, we evaluated the relative importance of different resolutions of pesticide usage data for assessing expected carbaryl exposure to endangered plant species endemic to California. We found that spatially explicit, township resolution usage data (~36 mile2) excluded 33% of terrestrial plants (55/168) and 51% their critical habitats (27/53) from requiring a Section 7 consultation, while coarser resolution data excluded none. In contrast, the EPA's biological evaluation for carbaryl only excludes 4% of terrestrial plants (nationally) from requiring formal Section 7 consultation. This suggests high‐resolution data could increase pesticide review efficiency and decrease the amount of time pesticides remain on the market without a formal evaluation.

Inclusion, delivery, assessment, and outcomes in longitudinal research on sleep disturbance and agitation in TBI-rehabilitation: lessons learned and future considerations

ABSTRACT Purpose This article presents some issues for consideration before scaling from a pilot study to a larger investigation in longitudinal observational studies of traumatic brain injury (TBI) rehabilitation. Materials and methods We present a case to discuss protocol improvements in longitudinal TBI-rehabilitation studies. The case was a pilot study conducted at two university hospitals in Denmark investigating 1-year outcomes related to sleep disturbance and agitation during neurointensive care. We included patients with moderate and severe TBI determined by the Glasgow Coma Scale, sleep disturbance was assessed using actigraphy, and agitation was assessed using the Agitated Behavior Scale. Results Patients (n = 29) were more severely ill and had poorer six-month outcomes in Eastern vs. Western Denmark. Recovery was similar at one-year follow-up. Protocol improvements were needed in relation to inclusion criteria, intervention delivery, patient assessment, and follow-up outcomes. Conclusion In TBI-rehabilitation studies, we suggest adding the severity of disease score to the initial GCS score and a delirium detection score to the ABS score. Actigraphy should not be used during deep sedation. Established procedures should be in place along all stages of the study protocol, including preparation and periodic assessment of study nurses to optimize data quality.

The Rich and the Hard-Working: Roman Villae Near Lake Attersee, Austria

– Large-area high-resolution magnetic and GPR surveys of whole Roman villa sites in Noricum, where no such settlements have been excavated in total so far. – Using image fusion to combine magnetometry and GPR data from low contrast soils to optimise data quality.

An Insider’s Take on Data Curation: Context, Quality, and Efficiency

This commentary describes how context, quality, and efficiency guide data curation at the University of Michigan's Inter-university Consortium for Political and Social Research (ICPSR). These three principals manifest from necessity. A primary purpose of this work is to facilitate secondary data analysis but in order to so, the context of data must be documented. Since a mistake in this work would render any results published from the data inaccurate, quality is paramount. However, optimizing data quality can be time consuming, so automative curation practices are necessary for efficiency. The implementation of these principles (context, quality, and efficiency) is demonstrated by a recent case study with a high-profile dataset. As the nature of data work changes, these principles will continue to guide the practice of curation and establish valuable skills for future curators to cultivate.

Long COVID and Health Inequities: The Role of Primary Care.

Policy Points An estimated 700,000 people in the United States have “long COVID,” that is, symptoms of COVID‐19 persisting beyond three weeks.COVID‐19 and its long‐term sequelae are strongly influenced by social determinants such as poverty and by structural inequalities such as racism and discrimination.Primary care providers are in a unique position to provide and coordinate care for vulnerable patients with long COVID.Policy measures should include strengthening primary care, optimizing data quality, and addressing the multiple nested domains of inequity.

Methodological improvements to a Procedure for Rapidly Establishing Steady-State Behavior.

We performed three experiments to improve the quality and retention of data obtained from a Procedure for Rapidly Establishing Steady-State Behavior (PRESS-B; Klapes et al.,2020). In Experiment 1, 120 participants worked on nine concurrent random-interval random-interval (conc RI RI) schedules and were assigned to four conditions of varying changeover delay (COD) length. The 0.5-s COD condition group exhibited the fewest instances of exclusive reinforcer acquisition. Importantly, this group did not differ in generalized matching law (GML) fit quality from the other groups. In Experiment 2, 60 participants worked on nine conc RI RI schedules with a wider range of scheduled reinforcement rate ratios than was used in Experiment 1. Participants showed dramatic reductions in exclusive reinforcer acquisition. Experiment 3 entailed a replication of Experiment 2 wherein blackout periods were implemented between the schedule presentations and each schedule remained in operation until at least one reinforcer was acquired on each alternative. GML fit quality was slightly more consistent in Experiment 3 than in the previous experiments. Thus, these results suggest that future PRESS-B studies should implement a shorter COD, a wider and richer scheduled reinforcement rate ratio range, and brief blackouts between schedule presentations for optimal data quality and retention.

Accounting and Smart System: Functional Evaluation of ISO/IEC 25010:2011 Quality Model (a Case Study)

Agile, flexible, and adaptable are important elements in the era of industrial 4.0, and vastly become new objectives by all entrepreneurs in developing their business information systems. As the most productive market in the global economy, Small and Medium Enterprises (SME) plays a vital role in developing countries. An ideal SME must have a standardized in the planning system and have an optimal quality of data model to run the business process and its operation. In the accounting system, all transaction data must be integrated to become a source of data for further processes such as recording sales or purchases, financial reporting, and generating invoices. The absence of technology and automated system in the accounting processes of SMEs, frequently waste both time, assets, and resources to be finished. Open-source ERP system implementation is often to be the initial step for SMEs to create a smart system that automating the business processes and operation’s needs. However, accurate parameters are needed to achieve an optimal system and data quality. The objective of this study is to evaluate the functional suitability level of smart ERP in the SME sector based on ISO 25010: 2011 standardization, and to produce good quality systems, as a result of the success of smart ERP systems implementation in automating business processes and integrating data across departments.

Improving data quality in observational research studies: Report of the Cure Glomerulonephropathy (CureGN) network

BackgroundHigh data quality is of crucial importance to the integrity of research projects. In the conduct of multi-center observational cohort studies with increasing types and quantities of data, maintaining data quality is challenging, with few published guidelines. MethodsThe Cure Glomerulonephropathy (CureGN) Network has established numerous quality control procedures to manage the 70 participating sites in the United States, Canada, and Europe. This effort is supported and guided by the activities of several committees, including Data Quality, Recruitment and Retention, and Central Review, that work in tandem with the Data Coordinating Center to monitor the study. We have implemented coordinator training and feedback channels, data queries of questionable or missing data, and developed performance metrics for recruitment, retention, visit completion, data entry, recording of patient-reported outcomes, collection, shipping and accessing of biological samples and pathology materials, and processing, cataloging and accessing genetic data and materials. ResultsWe describe the development of data queries and site Report Cards, and their use in monitoring and encouraging excellence in site performance. We demonstrate improvements in data quality and completeness over 4 years after implementing these activities. We describe quality initiatives addressing specific challenges in collecting and cataloging whole slide images and other kidney pathology data, and novel methods of data quality assessment. ConclusionsThis paper reports the CureGN experience in optimizing data quality and underscores the importance of general and study-specific data quality initiatives to maintain excellence in the research measures of a multi-center observational study.

Impact of the acquisition protocol on the sensitivity to demyelination and axonal loss of clinically feasible DWI techniques: a simulation study.

To evaluate: (a) the specific effect that the demyelination and axonal loss have on the DW signal, and (b) the impact of the sequence parameters on the sensitivity to damage of two clinically feasible DWI techniques, i.e. DKI and NODDI. We performed a Monte Carlo simulation of water diffusion inside a novel synthetic model of white matter in the presence of axonal loss and demyelination, with three compartments with permeable boundaries between them. We compared DKI and NODDI in their ability to detect and assess the damage, using several acquisition protocols. We used the F test statistic as an index of the sensitivity for each DWI parameter to axonal loss and demyelination, respectively. DKI parameters significantly changed with increasing axonal loss, but, in most cases, not with demyelination; all the NODDI parameters showed sensitivity to both the damage processes (at p < 0.01). However, the acquisition protocol strongly affected the sensitivity to damage of both the DKI and NODDI parameters and, especially for NODDI, the parameter absolute values also. This work is expected to impact future choices for investigating white matter microstructure in focusing on specific stages of the disease, and for selecting the appropriate experimental framework to obtain optimal data quality given the purpose of the experiment.

Using Smartphone-Based Ecological Momentary Assessment in Audiology Research: The Participants' Perspective.

Purpose The article's purpose was to examine participants' impressions and experiences with smartphone-based ecological momentary assessment (EMA) to inform future EMA study design. Method Adults with hearing impairment (HI, n = 9) and with normal hearing (NH, n = 10) participated in a study using a smartphone-based EMA system to measure their auditory lifestyles. A 14-item survey was scheduled to deliver every 45 min by an EMA app. After a 1-week trial, participants were interviewed regarding their study experiences. The app log files were analyzed to understand how the participants interacted with the app. Results Across the two groups, 1,295 surveys were completed (compliance rate 74.4%). On average, HI participants completed 10.0 and NH participants completed 9.1 surveys per day. The mean survey completion time for HI and NH groups were 72 s and 51 s, respectively. For both groups, about 90% of the participants reported the app as easy to use; about 60% of the participants reported that repetitive surveys interrupted or somewhat interrupted their activities. Participants reported surveys disrupting situations, for example, working, driving, and social events, and that they were more likely to skip surveys in these situations. Additionally, 50% of NH and 30% of HI participants indicated that the survey was not delivered too frequently and none indicated that the survey was too long. Conclusion Overall, the app and EMA design seem to be appropriate. Insights from this study can help researchers design their studies to adequately assess listeners' experience in the field with optimal compliance and data quality.

Looking beyond the numbers: quality assurance procedures in the Global Network for Women\u2019s and Children\u2019s Health Research Maternal Newborn Health Registry

BackgroundQuality assurance (QA) is a process that should be an integral part of research to protect the rights and safety of study participants and to reduce the likelihood that the results are affected by bias in data collection. Most QA plans include processes related to study preparation and regulatory compliance, data collection, data analysis and publication of study results. However, little detailed information is available on the specific procedures associated with QA processes to ensure high-quality data in multi-site studies.MethodsThe Global Network for Women’s and Children’s Health Maternal Newborn Health Registy (MNHR) is a prospective population-based registry of pregnancies and deliveries that is carried out in 8 international sites. Since its inception, QA procedures have been utilized to ensure the quality of the data. More recently, a training and certification process was developed to ensure that standardized, scientifically accurate clinical definitions are used consistently across sites. Staff complete a web-based training module that reviews the MNHR study protocol, study forms and clinical definitions developed by MNHR investigators and are certified through a multiple choice examination prior to initiating study activities and every six months thereafter. A standardized procedure for supervision and evaluation of field staff is carried out to ensure that research activites are conducted according to the protocol across all the MNHR sites.ConclusionsWe developed standardized QA processes for training, certification and supervision of the MNHR, a multisite research registry. It is expected that these activities, together with ongoing QA processes, will help to further optimize data quality for this protocol.

Clinical Outcome Event Adjudication in a 10-Year Prospective Study of Nucleos(t)ide Analogue Therapy for Chronic Hepatitis B

Background and Aims: In the REALM (Randomized, Observational Study of Entecavir to Assess Long-Term Outcomes Associated with Nucleoside/Nucleotide Monotherapy for Patients with Chronic HBV Infection) study, 12,378 patients with chronic hepatitis B virus (HBV) infection received up to 10 years of randomized therapy with entecavir or another HBV nucleos(t)ide analogue. Monitored clinical outcome events (COEs) included malignant neoplasms, HBV disease progression events, and deaths. An external event adjudication committee (EAC) was convened to provide real-time review of reported COEs to optimize data quality, and minimize potential adverse effects of the large cohort, interdisciplinary outcome assessments, geographic scope, and long duration. Methods: The EAC comprised an international group of hepatologists and oncologists with expertise in diagnosis of targeted COEs. The EAC reviewed and adjudicated COEs according to prospectively defined diagnostic criteria captured in the EAC charter. Operational processes, including data collection and query procedures, were implemented to optimize efficiency of data recovery to maximize capture of adjudicated COEs, the primary study outcome measure. Results: A total of 1724 COEs were reported and 1465 of these events were adjudicated by the EAC as reported by the investigators (85.0% overall concordance). Concordance by COE type varied: deaths, 99.6%; hepatocellular carcinoma (HCC), 83.3%; non-HCC malignancies, 88.0%; non-HCC HBV disease progression, 68.2%. Reasons for lack of concordance were most commonly lack of adequate supporting data to support an adjudicated diagnosis or evidence that the event pre-dated the study. Conclusions: The REALM EAC performed a critical role in ensuring data quality and consistency; EAC performance was facilitated by well-defined diagnostic criteria, effective data capture, and efficient operational processes.Trial registration: ClinicalTrials.gov NCT00388674.

Multiple breath washout in bronchiectasis clinical trials: is it feasible?

BackgroundEvaluation of multiple breath washout (MBW) set-up including staff training, certification and central “over-reading” for data quality control is essential to determine the feasibility of MBW in future bronchiectasis studies.AimsTo assess the outcomes of a MBW training, certification and central over-reading programme.MethodsMBW training and certification was conducted in European sites collecting lung clearance index (LCI) data in the BronchUK Clinimetrics and/or i-BEST-1 studies. The blended training programme included the use of an eLearning tool and a 1-day face-to-face session. Sites submitted MBW data to trained central over-readers who determined validity and quality.ResultsThirteen training days were delivered to 56 participants from 22 sites. Of 22 sites, 18 (82%) were MBW naïve. Participant knowledge and confidence increased significantly (p<0.001). By the end of the study recruitment, 15 of 22 sites (68%) had completed certification with a mean (range) time since training of 6.2 (3–14) months. In the BronchUK Clinimetrics study, 468 of 589 (79%) tests met the quality criteria following central over-reading, compared with 137 of 236 (58%) tests in the i-BEST-1 study.ConclusionsLCI is feasible in a bronchiectasis multicentre clinical trial setting; however, consideration of site experience in terms of training as well as assessment of skill drift and the need for re-training may be important to reduce time to certification and optimise data quality. Longer times to certification, a higher percentage of naïve sites and patients with worse lung function may have contributed to the lower success rate in the i-BEST-1 study.

Patients self-mastery of wearable devices for seizure detection: A direct user-experience

Purposewearable devices aimed at detecting seizures are rapidly emerging. Continuous collection and optimal data quality are paramount to guarantee the acquisition of clinically meaningful data. It is still unknown how successfully patients can self-manage new technologies and which factors have an impact on this. We assessed the performance of patients managing a wrist-worn device. Methodpatients wearing a wrist-worn device received a single training session to perform 5 tasks: (1) fitting the device correctly; (2) switching the device on and off; (3) charging the device on a daily basis; (4) pairing the device with a phone or tablet; (5) seeking assistance. Participants were then reviewed every 24 h and, at the end of the study, a Wearable technology Self-management Score (WSS) was calculated according to their performance in the different tasks (0–12). The association between WSS, seizure capture, demographics and clinical characteristics was analysed. ResultsThirty patients were included. The mean WSS score was 9.4 ± 2.1 points. The task more often performed inaccurately was pairing the device with a phone or tablet, followed by performing charging procedures. A strong association was found between WSS and seizure capture (p = 0.019), with higher scores strongly associated with more seizures captured. A WSS of ≥9 was the minimum value of WSS that allowed the device to record all the seizures. Number of AEDs and illness-perception related factors (perceived disease timeline and personal control) were significantly associated with WSS. ConclusionsOverall, participants demonstrated good performances in self-managing a wrist-worn device. Digital inequalities may extend to variations in how different individuals feel about their own disease and, consequently, manage the technology. These aspects should be addressed when technological solutions are delivered to users.