Visual Format Research Articles

Graphical Shading Logs: An Improved Approach for Collecting High Resolution Sedimentological Data at Contaminated Sites

AbstractPredicting contaminant transport in groundwater requires an accurate representation of the subsurface geology controlling the spatial distribution of hydrogeologic parameters. Developing accurate geological models for sedimentary systems relies on quality sedimentological data collected from cores. Standard logging forms used to collect data from cores create a persistent data gap in hydrogeology because they hinder efficient collection of high‐quality sedimentological data. These logging forms require time‐consuming text descriptions of sedimentological characteristics and often result in inconsistent, poorly resolved data insufficient to support realistic geological models. We describe a graphical approach to core logging, the graphical shading log, that facilitates rapid, accurate capture of sedimentological data and a complementary database to store the raw data and interpretations. The visual format of the graphical shading log provides a roadmap of the parameters to log and their possible values, helping to ensure accurate and consistent data collection by loggers with a range of experience. Examples from sites with contaminated groundwater in glaciogenic sediments and siliciclastic and carbonate bedrock show how data from the graphical shading logs improved geological interpretations, supported the design of high‐resolution multilevel systems needed to collect minimally blended hydrogeologic data, and helped to more accurately delineate hydrogeologic units. The format of the graphical shading log and complementary database are designed to be customizable and transferable between hydrogeologic settings providing a new tool to advance geological data collection and management. Improved sedimentological data and insight are critical inputs for process‐based conceptual site models needed to effectively manage contaminant plumes in the subsurface.

Sistem Informasi Geografis Pemetaan Reklame Berbasis Web

Licensing of billboards is managed by a government agency, namely the Medan City One Stop Integrated Service and Investment Service (DPMPTSP) in the fields of Licensing, Spatial Planning and Development. This study discusses the problems that occur in the Medan City DPMPTSP regarding mapping and monitoring billboard licensing by utilizing Leaflet JS technology as a medium for integrating maps into the web. The system is equipped with a route feature closest to the billboard location and is equipped with a mapping and a list of road locations that are justified and not allowed for advertising. This study uses Quantum GIS to convert shp files into GeoJSON format and Leaflet JS for map visualization. The system created can make it easier for DPMPTSP to manage and find out the status of billboards quickly and accurately and can provide information related to licensing the installation of billboards to the general public.

A Community-Driven, Openly Accessible Molecular Pathway Integrating Knowledge on Malignant Pleural Mesothelioma.

Malignant pleural mesothelioma (MPM) is a highly aggressive malignancy mainly triggered by exposure to asbestos and characterized by complex biology. A significant body of knowledge has been generated over the decades by the research community which has improved our understanding of the disease toward prevention, diagnostic opportunities and new treatments. Omics technologies are opening for additional levels of information and hypotheses. Given the growing complexity and technological spread of biological knowledge in MPM, there is an increasing need for an integrating tool that may allow scientists to access the information and analyze data in a simple and interactive way. We envisioned that a platform to capture this widespread and fast-growing body of knowledge in a machine-readable and simple visual format together with tools for automated large-scale data analysis could be an important support for the work of the general scientist in MPM and for the community to share, critically discuss, distribute and eventually advance scientific results. Toward this goal, with the support of experts in the field and informed by existing literature, we have developed the first version of a molecular pathway model of MPM in the biological pathway database WikiPathways. This provides a visual and interactive overview of interactions and connections between the most central genes, proteins and molecular pathways known to be involved or altered in MPM. Currently, 455 unique genes and 247 interactions are included, derived after stringent manual curation of an initial 39 literature references. The pathway model provides a directly employable research tool with links to common databases and repositories for the exploration and the analysis of omics data. The resource is publicly available in the WikiPathways database (Wikipathways : WP5087) and continues to be under development and curation by the community, enabling the scientists in MPM to actively participate in the prioritization of shared biological knowledge.

Understanding signaling and metabolic paths using semantified and harmonized information about biological interactions.

To grasp the complexity of biological processes, the biological knowledge is often translated into schematic diagrams of, for example, signalling and metabolic pathways. These pathway diagrams describe relevant connections between biological entities and incorporate domain knowledge in a visual format making it easier for humans to interpret. Still, these diagrams can be represented in machine readable formats, as done in the KEGG, Reactome, and WikiPathways databases. However, while humans are good at interpreting the message of the creators of diagrams, algorithms struggle when the diversity in drawing approaches increases. WikiPathways supports multiple drawing styles which need harmonizing to offer semantically enriched access. Particularly challenging, here, are the interactions between the biological entities that underlie the biological causality. These interactions provide information about the biological process (metabolic conversion, inhibition, etc.), the direction, and the participating entities. Availability of the interactions in a semantic and harmonized format is essential for searching the full network of biological interactions. We here study how the graphically-modelled biological knowledge in diagrams can be semantified and harmonized, and exemplify how the resulting data is used to programmatically answer biological questions. We find that we can translate graphically modelled knowledge to a sufficient degree into a semantic model and discuss some of the current limitations. We then use this to show that reproducible notebooks can be used to explore up- and downstream targets of MECP2 and to analyse the sphingolipid metabolism. Our results demonstrate that most of the graphical biological knowledge from WikiPathways is modelled into the semantic layer with the semantic information intact and connectivity information preserved. Being able to evaluate how biological elements affect each other is useful and allows, for example, the identification of up or downstream targets that will have a similar effect when modified.

Musical Experience in the Bower: D. G. Rossetti, Listening, and Space

Abstract This essay traces Dante Gabriel Rossetti’s use of the bower as a visual space in relation to musical subject matter. Following the increasing popularity of instrumental music and musical discourse in the mid-nineteenth century, the idea of art music and its expressive abilities had become a pervasive discourse for painters. Through an examination of Rossetti’s images of bowers with a musical subject – specifically The Blue Bower (1865), Veronica Veronese (1872), and La Ghirlandata (1873) – this essay explores ideas of musical temporality and artistic spatiality, tonal relations between colour and music, and Rossetti’s emphasis on subjective experience in these images. The bower became a crucial feature in this exploration of music and painting, signalling a visual space characterized by ideas of immersion, artistic correspondences, and the abstracting of colour and form. This essay proposes that Rossetti’s bowers were sites of visual immersion for its viewers, alluding and appealing to the sensuous impact music could have on a listener by mimicking listening behaviour in a visual format. My discussion uncovers new contexts for Rossetti’s musical images and draws parallels between listening and viewing behaviour for both the Victorian and current public. The essay concludes that visual sites alluding to music can act as immersive spaces, contending that abstraction and temporality are drawn out in painting by virtue of an appeal to music.

A Population-based Study of Temporal Lobe Malignancies

Background: Temporal lobe malignancies can pose a challenge given the important functions of the temporal lobe including auditory and visual sensory processing, language recognition, and memory formation. This study aimed to utilize the 1973-2015 Surveillance, Epidemiology, and End Results (SEER) to identify demographic and treatment differences affecting overall survival in patients with temporal lobe malignancies. Methods: A search of the SEER database for patients with malignant temporal lobe tumors was performed. The Kaplan Meier method was used to analyze univariate factors affecting overall survival. Logistic regression analysis was used to perform a multivariate analysis of overall survival. Results: A total of 12,690 patients were identified. The male to female ratio was 1.5:1. The majority of patients were treated with surgery as part of their treatment regimen. On univariate analysis surgical vs. nonsurgical treatment, tumor histology, sex, and race significantly affected overall survival. On multivariate analysis race, sex, and surgical vs. nonsurgical treatment significantly affected overall survival. Conclusions: Surgical treatment, non-white race, and female sex were associated with significantly increased overall survival in patients with temporal lobe malignancies.

Evaluation of a gallery-based Arts Engagement program for depression

ABSTRACT Objective Engagement with the arts has gained recognition as a promising avenue for addressing the social determinants that contribute to and maintain mental health concerns. The aim of the present study was to determine the impact of a gallery-based Arts Engagement program specifically for individuals living with depression. Methods Thirty two participants were randomly assigned to two terms of the program. Individual interviews and the group-based visual matrix format were utilised to generate qualitative data, which was subjected to thematic analysis. Results Participants identified that the program helped them feel more included, positively impacted their sense of identity, and counteracted negative cognitive, emotional, and behavioural patterns. Furthermore, the gallery, as a culturally important, non-medical institution, acted as a powerful destigmatizing agent. Conclusion Our results demonstrate how community-based, non-clinical art programs may be promising in promoting recovery from depression. KEY POINTS What is already known about this topic: Social prescribing has been shown to improve positive aspects of wellbeing, such as social connection and self-esteem, while also decreasing symptoms of depression and anxiety. Social prescribing provides an important augmentation to traditional psychological intervention. Engagement with the arts is a promising avenue for addressing the social determinants that contribute to and maintain mental health concerns. What this topic adds: Gallery-based programs can support wellbeing, through social inclusion, connectedness, and hopefulness. Gallery-based programs have the potential to counteract negative cognitive, emotional, and behavioural patterns. Basing programs in culturally important, non-medical institutions, such as public art galleries, can serve as a destigmatizing agent and contribute towards self-esteem and belonging.

COMPARATIVE ANALYSIS OF THE FEATURES OF THE FORMATION OF THE PERSONALITY COMPONENT OF THE CREATIVE ACTIVITY OF ADOLESCENTS WITH VISUAL IMPAIRMENTS AND WITH NORMAL VISION

The article implements a comparative analysis of the peculiarities of the formation of the personal component of creative activity of adolescents with visual impairments and normal vision. This study was implemented using the personality-oriented approach. To ensure the reliability of the results, conclusions, and achieve the goal of the study, a set of methods was used: theoretical (deductive – for a systematic description of the phenomenon under study, inductive – to establish patterns, their systematization on the basis of the results obtained), empirical method (a statement experiment using a psychodiagnostic technique). For the first time, in this study was represented a comparative analysis of the peculiarities of the personality component of creative activity of adolescents with visual impairments relative to their peers without visual impairments formation. The results of the study give grounds to conclude that it is necessary to work on the formation of a personality component of creative activity of adolescents with visual impairments.

Capturing and Articulating Visual Media as Scholarship.

Recent advancements in social media and educational technologies have facilitated dissemination of information in visual formats to broad audiences. When academic and creative visual media work is of high quality and accessible via various platforms (eg, in journals, on websites), it can meet the definition of scholarship.However, visual scholarship is sometimes viewed as an afterthought. For example, even venues that include visual abstracts with manuscripts may encourage authors to create visual abstracts post-submission to promote the article rather than as an independent scholarly pursuit. Typically, annual performance reviews, accreditation requirements, and promotion and tenure processes do not recognize or reward visual media as scholarly activity, despite the considerable technical and pedagogical skills required for its creation.The updated Accreditation Council for Graduate Medical Education (ACGME) Common Program Requirements define scholarship as including discovery, application, and teaching.1 This position builds on antecedent work by Boyer and Glassick.2,3The Declaration on Research Assessment (DORA) has encouraged scholars to equitably acknowledge each form of scholarship by using specific quality metrics, rather than relying on surrogate measures such as impact factor.4 DORA explores how we can value various forms of visual scholarship as meaningful contributions to the medical and medical education communities. For example, infographics and tweetorials can be examined by dissemination measures using journal-based or platform-based metrics such as Altmetric or Twitter analytics, respectively.5

Meningkatkan Minat Baca dengan Membangun Budaya Literasi Pada Anak Panti

Literacy activities are becoming increasingly vital and are being implemented on a large scale. Literacy is defined as the capacity to read and write in general. Literacy, on the other hand, is more than just reading and writing; it also encompasses the ability to utilise knowledge sources in print, visual, digital, and auditory formats. Early childhood is the most essential stage for the creation of children's knowledge and conduct, so literacy activities must begin then. Children have a good recall at this age because their personalities are undeveloped, making it simple for them to get caught up in behaviors that are common in everyday life. As a result, PKL I was carried out at the Sinar Damai Sejahtera Orphanage Foundation in order to help one of the children who lacked interest in reading and learning develop a literacy culture from an early age. The micro intervention method is used in the helping process (case work). As indicated by the rise of children's excitement for learning and interest in reading, the goal of this activity was reported to be met.

Student Approaches and Performance in Element Sequencing Tasks Using 2D and Augmented Reality Formats

In civil and construction engineering education research, a focus has been on using 3D models to support students’ design comprehension. Despite this trend, the predominant mode of design communication in the industry relies on 2D plans and specifications, which typically supersede other modes of communication. Rather than focusing on the presentation of less common 3D content as an input to support students’ understanding of a design, this paper explores more common 2D inputs, but compares different visualization formats of student output in two educational interventions. In the first intervention, students document a construction sequence for wood-framed elements in a 2D worksheet format. In the second, students work with the same wood-framed design, but document their sequence through an augmented reality (AR) format where their physical interactions move full-scale virtual elements as if they were physically constructing the wood frame. Student approaches and performance were analyzed using qualitative attribute coding of video, audio, and written documentation of the student experience. Overall, results showed that the 2D worksheet format was simple to implement and was not mentally demanding to complete, but often corresponded with a lack of critical checks and a lack of mistake recognition from the students. The AR approach challenged students more in terms of cognitive load and completion rates but showed the potential for facilitating mistake recognition and self-remediation through visualization. These results suggest that when students are tasked with conceptualizing construction sequences from 2D documentation, the cognitive challenges associated with documenting a sequence in AR may support their recognition of their own mistakes in ways that may not be effectively supported through 2D documentation as an output for documenting and planning a construction sequence. The results presented in this paper provide insights on student tendencies, behaviors, and perceptions related to defining construction sequences from 2D documentation in order for educators to make informed decisions regarding the use of similar learning activities to prepare their students for understanding the 2D design documents used in industry.

The impact of visual narrative formats on women's entrepreneurship training

This paper analyses the impact of visual narrative formats on women's entrepreneurship training. The findings suggest that the development of competences such as entrepreneurship concepts, opportunity identification and entrepreneurial intention are comparatively better when training with visual narrative format than with a traditional textbook format. Results reveal that the visual narrative not only is an effective tool in the development of new concepts but also strengthens the concepts of students with previous experience in entrepreneurship but little time available for studying. This visual narrative enhances the connection between theory and practice while allowing for easier identification of more innovative and viable business ideas. The project also encourages entrepreneurial initiative because the students can identify with one or another of the main characters in the visual narrative format.

Creating loyalty: Communication practices in the European and Inter-American human rights regimes

AbstractThis article investigates how the European and Inter-American human rights regimes have developed communication practices to create loyalty. It argues that communication departments exercise essential functions, in particular by creating diffuse support for international courts. By relying on theoretical analyses developed by Albert O. Hirschman and David Easton, it identifies how international courts can create loyalty through, first, fostering awareness about the existence of the court among the general public, and, second, the establishment of supportive communities around the court through shared practices. By drawing on semi-structured interviews, the comparative analysis of the European and Inter-American human rights regime illustrates both the professionalization of communication actors and the evolution of specific communication strategies in times of backlash. The empirical insights derived from semi-structured interviews with communication officials highlight how they have succeeded in expanding their audiences, but struggle with activating communities of practice. Ultimately, the rise of visual media formats and story-telling narratives might be the most promising tool to portray a more positive and engaging image of the institution.

Expertise, playfulness and analogical reasoning: three strategies to train Artificial Intelligence for design applications

This paper presents a theoretical framework for the implementation of Artificial Intelligence (AI) in architectural and structural design processes, and it is complemented by some practical applications. The aim is to demonstrate that AI can be used to simulate certain aspects of human cognition and can therefore be integrated into CAD software to support conceptual design and idea generation in a number of different ways. The aim of this study is also to investigate to what extent AI models can interact with a designer to explore future forms of human–machine interaction, including autonomous and participative design. This study identifies and applies AI models to simulate three distinct learning mechanisms: design expertise, playfulness and analogical reasoning. Each strategy has been applied to train different AI models, including generative models and reinforcement learning agents. In the first application, the AI model extracts visual features from a dataset of shell and spatial structures, and then recombines such features to generate new design propositions. In the second application, an AI agent learns a design strategy to solve a toy-design problem with no prior knowledge of precedents. The third application illustrates that AI can be trained to discover meaningful features from biological forms and generate simple design objects through the visual abstraction of such forms. The applications demonstrate the ability of AI to synthesise design options and interact with a designer through visual data formats, such as 2D images and 3D models. This work does not focus on assessing the usefulness of AI models in a real-world design scenario, or on comparing AI with current computational design tools and approaches. It instead investigates different forms of design exploration for computational design purposes, thus paving the way for the development of future autonomous and participative design systems.

PELATIHAN MEDIA CANVA DALAM MENINGKATKAN LITERASI DIGITAL DAN KREATIVITAS ANAK DI DESA SUMBERJAYA

Education today must improve the quality of learning that is more innovative and creative. Learning media is one of the supporting components in learning, during this pandemic many schools are doing the learning process online because of social distancing restrictions that make the capacity of this school limited. The presentation of interesting, creative, and informative information or news is one of the capital to create information that is easily accepted by readers, in addition, learning media also affects students' learning interests, one example of learning media is by using infographics presented in a visual format. Therefore, the author held a Real Work Lecture Program containing Canva Media Training activities to improve digital literacy and creativity for children which will be held at Griya Pratama Bekasi RT / RW 001/034 Housing, Sumberjaya Village. This activity is carried out for 3 weeks. The goal is that with this training activity, the author wants to teach children who are in Griya Pratama Bekasi RT / RW 001 / 034 Housing, Sumberjaya Village has experience in designing. This activity has provided knowledge to the public/participants about the canva application which can be a reference for making infographic/poster designs, videos, logos, and even learning media as well. In addition, this training also improves the ability of participants in terms of innovative and creative skills.

Visualization formats of patient-reported outcome measures in clinical practice: a systematic review about preferences and interpretation accuracy

PurposeThe use of Patient-Reported Outcome Measures (PROMs) for individual patient management within clinical practice is becoming increasingly important. New evidence about graphic visualization formats for PROMs scores has become available. This systematic literature review evaluated evidence for graphic visualization formats of PROMs data in clinical practice for patients and clinicians, for both individual and group level PROMs data.MethodsStudies published between 2000 and 2020 were extracted from CINAHL, PubMed, PsychInfo, and Medline. Studies included patients ≥ 18 years old in daily clinical practice. Papers not available in English, without full-text access, or that did not specifically describe visualization of PROMs data were excluded. Outcomes were: visualization preferences; interpretation accuracy; guidance for clinical interpretation.ResultsTwenty-five out of 789 papers were included for final analysis. Most frequently studied formats were: bar charts, line graphs, and pie charts. Patients preferred bar charts and line graphs as these were easy and quick for retrieving information about their PROMs scores over time. Clinicians’ interpretation accuracy and preferences were similar among graphic visualization formats. Scores were most often compared with patients’ own previous scores; to further guide clinical interpretation, scores were compared to norm population scores. Different ‘add-ons’ improved interpretability for patients and clinicians, e.g. using colors, descriptions of measurement scale directionality, descriptive labels, and brief definitions.ConclusionThere was no predominant graphical visualization format approach in terms of preferences or interpretation accuracy for both patients and clinicians. Detailed clarification of graph content is essential.

EP504: A novel visualization of state-by-state variability in newborn screening highlights underrepresentation of lysosomal storage disorders

Newborn screening (NBS) is an important, cost-effective tool that can detect dozens of early-onset and treatable disorders in the approximately 3.6 million newborns who are screened in the US each year. The disorders covered on the NBS vary from state to state, and no two states screen for the same set of disorders. The state-level factors associated with the disorders covered on a particular state’s NBS have not been systematically investigated, even though this knowledge could have important implications for state and national NBS policy. Furthermore, the display of state-to-state NBS data in a visual format could provide a quick reference for policymakers to identify gaps in categories of disorders that are systematically underrepresented on the NBS at a national level. Publicly-available data on the disorders listed on the NBS in each state was obtained from www.babysfirsttest.org and www.newsteps.org, websites that curate state-level data on newborn screening, in Spring 2021. Disorders were then grouped into one of seven categories (eg, endocrine, amino acid, organic acid, fatty acid oxidation, lysosomal storage, hemoglobin, and other). Data was also sourced from publicly-available sources such as https://www.census.gov/ that contain state-level variables on population size and demographics. Data were collected using the program rvest (version 0.3.6) and were analyzed and visualized using ggplot2 (version 3.3.5) in the statistical programming language R (version 4.0.3). The resulting heatmap visualization of NBS contains disorders on the x-axis and states on the y-axis, with the value within each cell indicating whether a given state screens for a particular disorder. The NBS in Tennessee (67 disorders at the time of analysis), the state with the most conditions screened for, contains more than double the number of conditions screened for compared to Arizona, the state with the fewest conditions screened for (31 conditions). In general, states that have larger populations also tend to screen for more disorders on their NBS. In addition, 30 of the 36 primary disorders listed on the July 2018 version of the Recommended Uniform Screening Panel (RUSP), a national guideline of the minimum recommended conditions that should be present on a state’s NBS, were listed on the NBS for all states. Furthermore, the data highlight that few states are screening for lysosomal storage disorders (LSDs). In particular, Michigan, Tennessee, and Missouri are the only states to include 5 or more LSDs on their NBS panel, with over half of all states not including any LSDs on their NBS. This novel heatmap visualization highlights the striking variability present in NBS offerings between states. Summary statistics and an overview of the state-to-state variation in newborn screening in the U.S. can be rapidly ascertained from this visualization in a manner that was not previously possible. In particular, this visualization clearly demonstrates that lysosomal storage diseases are systematically underrepresented in newborn screening nationwide, despite the increasing availability of enzyme replacement therapies for this class of disorders. This publicly-available visualization of NBS will more easily allow advocates for particular disorders to identify gaps in NBS nationwide and within particular states.

DJExpress: An Integrated Application for Differential Splicing Analysis and Visualization.

RNA-seq analysis of alternative pre-mRNA splicing has facilitated an unprecedented understanding of transcriptome complexity in health and disease. However, despite the availability of countless bioinformatic pipelines for transcriptome-wide splicing analysis, the use of these tools is often limited to expert bioinformaticians. The need for high computational power, combined with computational outputs that are complicated to visualize and interpret present obstacles to the broader research community. Here we introduce DJExpress, an R package for differential expression analysis of transcriptomic features and expression-trait associations. To determine gene-level differential junction usage as well as associations between junction expression and molecular/clinical features, DJExpress uses raw splice junction counts as input data. Importantly, DJExpress runs on an average laptop computer and provides a set of interactive and intuitive visualization formats. In contrast to most existing pipelines, DJExpress can handle both annotated and de novo identified splice junctions, thereby allowing the quantification of novel splice events. Moreover, DJExpress offers a web-compatible graphical interface allowing the analysis of user-provided data as well as the visualization of splice events within our custom database of differential junction expression in cancer (DJEC DB). DJEC DB includes not only healthy and tumor tissue junction expression data from TCGA and GTEx repositories but also cancer cell line data from the DepMap project. The integration of DepMap functional genomics data sets allows association of junction expression with molecular features such as gene dependencies and drug response profiles. This facilitates identification of cancer cell models for specific splicing alterations that can then be used for functional characterization in the lab. Thus, DJExpress represents a powerful and user-friendly tool for exploration of alternative splicing alterations in RNA-seq data, including multi-level data integration of alternative splicing signatures in healthy tissue, tumors and cancer cell lines.

Air Quality Analysis in Lima, Peru Using the NO2 Levels during the COVID-19 Pandemic Lockdown

The emergence of the new COVID-19 virus in Peru forced the Peruvian government to take swift measures to stop its proliferation. Consequently, a state of emergency was declared, which included mandatory social isolation and quarantine. This action meant that people would transit only in emergency cases. In this context, this study’s objective is to analyze the air quality changes in terms of the capital city’s NO2 levels due to these government decisions using satellite imagery data obtained from the Sentinel-5P satellite. One critical problem is the lack of spatially distributed air quality data. The Peruvian Meteorological Service only monitors air quality in Lima, the capital city. In addition, the air quality ground stations are not always functioning. Thus, there is a need to find new reliable methods to complement the official data obtained. One method of doing so is the use of remote sensing products, although the accuracy and applicability are yet to be determined; therefore, this is the article’s focus. A temporal and spatial analysis was developed quantitatively and qualitatively to measure the levels of NO2 in eighteen regions of Lima to contrast the quarantine’s effect on polluting gas emission levels. The measurements are also compared with the official Peruvian data from ground sensors using Pearson correlation coefficients, thus, showing that Sentinel-5P data can be used for changes in the mean daily concentration of NO2. We also developed the first version of an open platform that converts the satellite data into a friendly format for visualization. The results show NO2 ambient concentration reductions compared to 2019 of between 60% and 40% in the first two weeks and between 50% and 25% in the following two weeks of the COVID-19 lockdown. However, this effect could not be observed two months after the start of the lockdown.

Measuring Political Knowledge and Not Search Proficiency in Online Surveys

Abstract Most online survey questions testing political knowledge are susceptible to measurement error when participants look up the answers. This article reports five studies of methods to detect and prevent this common source of error. To detect lookups, “catch questions” are more reliable than self-reports, because many participants lie rather than admit looking up answers. Strongly worded instructions reduced lookups by about two-thirds, while the triple combination of instructions, requesting a promise not to look up answers, and adaptive feedback (asking participants who look up an answer to stop doing so) reduced the percentage of respondents looking up an answer by a further half, to 3%. For office recall knowledge items, photo-based open-ended questions eliminated lookups and had similar validity to traditional text-based versions, making them a good choice when a visual format is viable.