Research Opportunities Research Articles

A Historical Survey of Advances in Transformer Architectures

In recent times, transformer-based deep learning models have risen in prominence in the field of machine learning for a variety of tasks such as computer vision and text generation. Given this increased interest, a historical outlook at the development and rapid progression of transformer-based models becomes imperative in order to gain an understanding of the rise of this key architecture. This paper presents a survey of key works related to the early development and implementation of transformer models in various domains such as generative deep learning and as backbones of large language models. Previous works are classified based on their historical approaches, followed by key works in the domain of text-based applications, image-based applications, and miscellaneous applications. A quantitative and qualitative analysis of the various approaches is presented. Additionally, recent directions of transformer-related research such as those in the biomedical and timeseries domains are discussed. Finally, future research opportunities, especially regarding the multi-modality and optimization of the transformer training process, are identified.

Qualitative research in the metaverse, a primer

New technology can be a source of great optimism and a force for positive change in the research industry. As such, it is important to discuss the merits of emerging technology. In this research note, the emergent opportunity for qualitative research in the metaverse is discussed. This paper looks at how rich sensory virtual environments with multiple sensory modalities might help address some of the shortcomings of traditional online qualitative research. The importance of establishing social presence in virtual qualitative research is addressed. Then, how the metaverse might help remove some of the constraints of ‘big qual’ is debated. The potential for the metaverse to improve participant inclusivity is considered, before finally discussing the issue of research ethics in a decentralised virtual world.

Studying complex causal processes in technological innovation and entrepreneurship with set-theoretic mediation models

Researchers often turn to linear mediation models to understand the complex causal processes inherent within innovation and entrepreneurship phenomena. However, these models are not always the most appropriate methods for increasing our understanding of these phenomena. This is because linear models depend on the principle of reductionism – which separates causal processes into their independent components – and overlooks systemwide attributes. To advance research findings that do not adequately address complex causal processes, we advocate using set-theoretic mediation models that offer analytical features better suited for holistically uncovering interdependent and intervening pathways. This method enables investigating complex causal processes associated with the conjunction, equifinality, and asymmetry that can occur with multiple interdependent variables. We provide researchers with practical guidance on constructing and testing set-theoretic mediation models using widely available software while demonstrating these procedures with an illustrative analysis. In doing so, we seek to guide researchers interested in integrating these models into their studies and recommend best practices for implementation. We argue that set-theoretic meditation models can be utilized in various contexts, as they offer new research opportunities for exploring unified necessity and sufficiency relational systems in ways existing methods have yet to address.

Mundane urban (im)mobilities: work, domestic, and family lives of migrant building workers in China

ABSTRACT Interdisciplinary research from China has generated a wealth of quantitative and qualitative insights into trans-, national, regional, and local migration patterns over long and short distances through attention to diverse topics, socio-economic groups, and case-study locations. Our contribution in this paper is to advance recent critical work that is directing focus from rural-to-urban “circular movements” toward more complex spatialities and temporalities. To add value to that project, we not only engage with studies of urban (im)mobilities per se but also elaborate productive new avenues from across interdisciplinary mobilities research. Specifically, we draw on feminist, materialist, and more-than-representational thinking to highlight the contingent relatedness of migrants’ daily lives across diverse work, domestic, and family times/spaces both within and beyond cities. In doing so, we show how exploration of mundane urban (im)mobilities offers new insights to challenge binary depictions of city/countryside, home/destination, movement/stasis, belonging/marginalization, and moored/unmoordness. The conclusion signposts new research opportunities.

Finding the needle in the haystack: archival research in European political science

AbstractThis short article offers a practical introduction to archival research for political scientists working on European politics. Archival documents are increasingly recognized as a relevant data source for process tracing analyses in small-N or mixed methods studies. Previously classified archival documents are exceptionally trustworthy due to their original confidentiality. Their rich and detailed content facilitates the understanding of causal mechanisms. Still, the hurdles for working with archival sources are high for political scientists. Lack of experience, no special training in handling historic documents, and a shortage of textbooks meeting their demands are a few of the problems political scientists planning archival research face. In the article, I highlight the opportunities of archival research and demonstrate how challenges can be overcome. I emphasize that the archival field trip should only be planned once researchers have gained substantive context knowledge. In their preparation, researchers should use all the resources archives offer and develop measurable expectations from theories.

The Best Protocol to Treat Equine Skin Wounds by Second Intention Healing: A Scoping Review of the Literature.

Equine skin wound treatment continues to be a challenge for veterinarians. Despite being a frequent practice, it remains difficult to choose an evidence-based treatment protocol. This study aimed to comprehensively explore the literature and provide a scoping review of therapeutic strategies for equine skin wounds and identify knowledge gaps and opportunities for future research. This review was conducted using specific criteria to select literature that described methods to manage second intention wound healing. After removing duplicates and screening papers for suitability, 81 manuscripts were included for data extraction. Of these, 59 articles were experimental studies, 10 were case reports, 9 were case series, and 3 were clinical studies. The most frequent wound location was the distal limbs. Macroscopic assessment was the main tool used to evaluate treatment effectiveness. All of the case reports, case series, and clinical studies reported positive outcomes with regard to the treatment used, while only 36% of the experimental studies found significant healing improvement in treated wounds compared to control groups. It was found that there are many treatments that have exhibited controversial results, and there exists a lack of evidence for the adoption of specific treatment protocols.

Understanding the emergence and significance of behavioral cybersecurity: A bibliometric analysis

This thorough bibliometric analysis, using R-Studio and Biblioshiny, presents a comprehensive view of the evolving field of behavioral cybersecurity. It explores how human behaviors in online cyber activities have become a crucial area of research. Despite being relatively new, behavioral cybersecurity has gained considerable attention in academia and practical applications. The analysis reveals essential details such as key sources, influential authors, participating countries, affiliated institutions, and prevalent research themes in this field. It's an essential guide for new researchers, helping them identify gaps in knowledge and understand the importance of this growing research area. Examining 468 literature sources from Scopus up to January 11, 2024, shows a gradual start followed by significant growth, especially after 2012. This dynamic field offers numerous research opportunities by incorporating human aspects into cybersecurity discussions. The focus is on understanding behavioral patterns to shape strategies, guidelines, and user-centered software solutions. Spotlighting behavior in cybersecurity highlights user cognitive biases and the impact of emotions and social factors on decision-making in the cybersecurity landscape. This holistic approach underscores the crucial role of human behavior in shaping cybersecurity practices and strengthening digital defenses.

Centralized exchanges vs. decentralized exchanges in cryptocurrency markets: A systematic literature review

Research on cryptocurrency exchanges, consisting of both centralized exchanges (CEXs) and decentralized exchanges (DEXs), has seen a significant increase in contributions in recent years, driven by growing interest in the conceptual design of cryptocurrency markets. Through a comprehensive review of literature published between January 2019 and September 2023, I identify and analyze different dimensions of the ongoing CEX vs. DEX debate. While DEXs emphasize decentralization, user control, and resistance to censorship, CEXs offer higher liquidity, advanced trading features, and a more established track record. Regulatory challenges, such as Know Your Customer (KYC) and Anti-Money Laundering (AML) compliance, also feature prominently in the literature and influence the choice of exchange for both traders and policymakers. In addition, I observe a growing interest in the design of pricing functions for CEXs and DEXs, particularly in the area of automated market makers (AMMs). Finally, based on my findings, I outline future research opportunities in this context and derive research gaps as well as recommended actions for practitioners.

Challenges and Opportunities of Education and Scientific Research in the United Arab Emirates

This study addressed the challenges and opportunities of education and scientific research in the United Arab Emirates. It discussed the relationship between educational outcomes, scientific research, and real-world requirements. It also highlighted the density of curricula and the accumulation of knowledge, noting that current educational curricula do not align with the demands of e-learning, which has emerged as a strong and new system in future education. The study emphasized the role of higher education and scientific research institutions in advancing and keeping pace with advanced countries. It stressed the importance of academic and research collaboration among higher education institutions, academic accreditation for programs, and the required skills for each specialization to serve both learners and the country. Regarding scientific research, the study observed a continuous decline due to reduced funding for research and decreased allocated funds by universities. It also discussed faculty members' challenges in their academic and administrative duties. The study concluded by proposing innovative solutions to address the challenges of education and scientific research in the United Arab Emirates.

Deep learning on spatiotemporal graphs: A systematic review, methodological landscape, and research opportunities

Deep learning approaches, given their low cost and high reliability, have gained much popularity in different subjects, such as computer vision and natural language processing, and more recently in graph data types. Spatiotemporal graph-based neural networks have been more and more developed to solve problems related to spatiotemporal data, mainly for analyzing changes over time and for provisioning purposes. In this systematic literature review, we have aimed to answer the most important questions regarding spatiotemporal graph deep learning architectures in different applications domains, such as traffic related topics, medical imaging, and geographical data analysis. We have selected more than 50 papers that cover a wide range of applications and very different architectures and innovations. We have also noticed that most of them consider the spatiotemporal graphs to be quite classic graphs without any further sophisticated modeling of temporal and spatial data evolution. Moreover, core problems (such as node classification, frequent pattern recognition, etc.) and application domains are not sufficiently addressed by the state-of-the-art. This study thus opens many perspectives to new developments in spatio-temporal graph deep learning with different strategies in order to solve various end-to-end tasks and other problems related to this special kind of graph.

Bridging Dense and Sparse Maximum Inner Product Search

Maximum inner product search (MIPS) over dense and sparse vectors have progressed independently in a bifurcated literature for decades; the latter is better known as top- \(k\) retrieval in Information Retrieval. This duality exists because sparse and dense vectors serve different end goals. That is despite the fact that they are manifestations of the same mathematical problem. In this work, we ask if algorithms for dense vectors could be applied effectively to sparse vectors, particularly those that violate the assumptions underlying top- \(k\) retrieval methods. We study clustering-based approximate MIPS where vectors are partitioned into clusters and only a fraction of clusters are searched during retrieval. We conduct a comprehensive analysis of dimensionality reduction for sparse vectors, and examine standard and spherical KMeans for partitioning. Our experiments demonstrate that clustering-based retrieval serves as an efficient solution for sparse MIPS. As byproducts, we identify two research opportunities and explore their potential. First, we cast the clustering-based paradigm as dynamic pruning and turn that insight into a novel organization of the inverted index for approximate MIPS over general sparse vectors. Second, we offer a unified regime for MIPS over vectors that have dense and sparse subspaces, that is robust to query distributions.

Architecture and functions of stomatal cell walls in eudicots and grasses.

Like all plant cells, the guard cells of stomatal complexes are encased in cell walls that are composed of diverse, interacting networks of polysaccharide polymers. The properties of these cell walls underpin the dynamic deformations that occur in guard cells as they expand and contract to drive the opening and closing of the stomatal pore, the regulation of which is critical for photosynthesis and water transport in plants. Our understanding of how cell wall mechanics are influenced by the nanoscale assembly of cell wall polymers in guard cell walls, how this architecture changes over stomatal development, maturation, and aging, and how the cell walls of stomatal guard cells might be tuned to optimize stomatal responses to dynamic environmental stimuli is still in its infancy. In this review, we discuss advances in our ability to experimentally probe and quantitatively model the structure and dynamics of guard cell walls across a range of plant species, highlighting new ideas and exciting opportunities for further research into these actively moving plant cells.

Effects of electroacupuncture on cognitive symptoms in major depressive disorder: a pilot study and randomized controlled trial

Objectives To investigate the impact of electroacupuncture on cognitive function, quality of life (QoL), and depression severity in patients with major depressive disorder (MDD). Methods This double-blinded randomized controlled trial included 60 participants aged 18-55 with cognitive symptoms related to MDD at Thammasat University Hospital. Participants were divided into two groups: the electroacupuncture group combined with standard antidepressant treatment (EG; n=30) and the control group receiving standard care with placebo acupuncture (CG; n=30). The study assessed 1) executive functions using the Trail making test- B and Stroop Color and Word Test, 2) delayed recall, and 3) subjective cognitive complaint and Quality of life (QoL) using WHODAS 2.0. Depressive symptoms were measured using the Thai version of the Patient Health Questionnaire (PHQ-9). Baseline and post-intervention assessments were conducted over 10 weeks. Mann-Whitney U test analyzed treatment effects by comparing median differences between groups. Results Both groups exhibited similar demographics and cognitive traits. Cognitive improvement was observed in both groups at the endpoint. Intention-to-treat analysis revealed significantly higher median scores for subjective cognitive complaints in the EG compared to the CG (EG: Median = 5.5, CG: Median = 0.0, p=0.049). No serious side effects were identified from either electroacupuncture or placebo acupuncture. Conclusions Electroacupuncture improved subjective complaints in MDD patients with cognitive symptoms, but did not show effects on specific cognitive functions, QoL, or depressive symptoms. This study provides initial evidence supporting the potential of electroacupuncture in MDD patients with cognitive symptoms, suggesting opportunities for further research. Trial registration NCT06239740, February 2, 2024, ClinicalTrials.gov.

Nanoproteases: Alternatives to Natural Protease for Biotechnological Applications.

Some nanomaterials with intrinsic protease-like activity have the advantages of good stability, biosafety, low price, large-scale preparation and unique property of nanomaterials, which are promising alternatives for natural proteases in various applications. An especial term, "nanoprotease", has been coined to stress the intrinsic proteolytic property of these nanomaterials. As a new generation of artificial proteases, they have become a burgeoning field, attracting many researchers to design and synthesize high performance nanoproteases. In this review, we summarize recent progress on all types of nanoproteases with regard of their activity, mechanism and application and introduce a new and effective strategy for engineering high-performance nanoproteases. In addition, we discuss the challenges and opportunities of nanoprotease research in the future.

Healthcare Sustainability to Address Climate Change: Call for Action to the Infectious Diseases Community.

The U.S. healthcare system's contribution to greenhouse gas emissions and climate change is disproportionately high and harms the public. Several medical specialties are now reassessing how they can mitigate healthcare's harmful environmental impact. Healthcare sustainability is broadly defined as measures to decrease greenhouse gas emissions, waste, and other pollutants generated during the healthcare delivery process. Prior efforts and programs by infectious diseases (ID) professionals, such as antimicrobial stewardship and infection prevention and control can form a framework for ID professionals to help apply this expertise to healthcare environmental sustainability more broadly. This call to action proposes strategies for ID societies and professionals to incorporate climate change education for trainees, increase research and funding opportunities in healthcare sustainability, and calls for action by ID societies to champion system changes to decrease greenhouse gas emissions.

Impact of maternal posture on fetal physiology in human pregnancy: a narrative review.

In numerous medical conditions, including pregnancy, gravity and posture interact to impact physiology and pathophysiology. Recent investigations, for example, pertaining to maternal sleeping posture during the third trimester and possible impact on fetal growth and stillbirth risk highlight the importance and potential clinical implications of the subject. In this review, we provide an extensive discussion of the impact of maternal posture on fetal physiology from conception to the postpartum period in human pregnancy. We conducted a systematic literature search of the MEDLINE database and identified 242 studies from 1991 through 2021, inclusive, that met our inclusion criteria. Herein, we provide a synthesis of the resulting literature. In the first section of the review, we group the results by the impact of maternal posture at rest on the cervix, uterus, placenta, umbilical cord, amniotic fluid, and fetus. In the second section of the review, we address the impact on fetal-related outcomes of maternal posture during various maternal activities (e.g., sleep, work, exercise), medical procedures (e.g., fertility, imaging, surgery), and labor and birth. We present the published literature, highlight gaps and discrepancies, and suggest future research opportunities and clinical practice changes. In sum, we anticipate that this review will shed light on the impact of maternal posture on fetal physiology in a manner that lends utility to researchers and clinicians who are working to improve maternal, fetal, and child health.

Brazilian Atmospheric Inventories – BRAIN: a comprehensive database of air quality in Brazil

Abstract. Developing air quality management systems to control the impacts of air pollution requires reliable data. However, current initiatives do not provide datasets with large spatial and temporal resolutions for developing air pollution policies in Brazil. Here, we introduce the Brazilian Atmospheric Inventories (BRAIN), the first comprehensive database of air quality and its drivers in Brazil. BRAIN encompasses hourly datasets of meteorology, emissions, and air quality. The emissions dataset includes vehicular emissions derived from the Brazilian Vehicular Emissions Inventory Software (BRAVES), industrial emissions produced with local data from the Brazilian environmental agencies, biomass burning emissions from FINN – Fire INventory from the National Center for Atmospheric Research (NCAR), and biogenic emissions from the Model of Emissions of Gases and Aerosols from Nature (MEGAN) (https://doi.org/10.57760/sciencedb.09858, Hoinaski et al., 2023a; https://doi.org/10.57760/sciencedb.09886, Hoinaski et al., 2023b). The meteorology dataset has been derived from the Weather Research and Forecasting Model (WRF) (https://doi.org/10.57760/sciencedb.09857, Hoinaski and Will, 2023a; https://doi.org/10.57760/sciencedb.09885, Hoinaski and Will, 2023c). The air quality dataset contains the surface concentration of 216 air pollutants produced from coupling meteorological and emissions datasets with the Community Multiscale Air Quality Modeling System (CMAQ) (https://doi.org/10.57760/sciencedb.09859, Hoinaski and Will, 2023b; https://doi.org/10.57760/sciencedb.09884, Hoinaski and Will, 2023d). We provide gridded data in two domains, one covering the Brazilian territory with 20×20 km spatial resolution and another covering southern Brazil with 4×4 km spatial resolution. This paper describes how the datasets were produced, their limitations, and their spatiotemporal features. To evaluate the quality of the database, we compare the air quality dataset with 244 air quality monitoring stations, providing the model's performance for each pollutant measured by the monitoring stations. We present a sample of the spatial variability of emissions, meteorology, and air quality in Brazil from 2019, revealing the hotspots of emissions and air pollution issues. By making BRAIN publicly available, we aim to provide the required data for developing air quality policies on municipal and state scales, especially for under-developed and data-scarce municipalities. We also envision that BRAIN has the potential to create new insights into and opportunities for air pollution research in Brazil.​​​​​​​

Newborn Screening for Congenital Cytomegalovirus

What Is the Issue? Congenital cytomegalovirus (cCMV) is estimated to affect between 0.2% and 2.4% of newborns worldwide, and may cause long-term effects, including hearing loss and neurodevelopmental disability. Newborn screening for cCMV can identify affected neonates and provide an opportunity for early treatment, which may reduce any long-term effects from infection. We wanted to know if universal newborn screening is a clinically effective and cost-effective intervention for identifying and managing cCMV. What Did We Do? We identified and summarized published literature comparing the clinical effectiveness and cost-effectiveness of universal newborn screening with either targeted newborn screening or no screening for congenital cytomegalovirus in neonates. We also identified and summarized published, evidence-based guidelines that make recommendations concerning the use of newborn screening for congenital cytomegalovirus to help inform decisions considering the use of this intervention. An information specialist searched for peer-reviewed and grey literature sources published between January 1, 2014, and March 19, 2024. The search was limited to English-language documents. One reviewer screened articles for eligibility based on predefined criteria, critically appraised the included studies, and narratively summarized the findings. What Did We Find? Evidence from 1 prospective cohort study in the US found that, compared to universal newborn screening for cCMV, targeted newborn screening failed to identify a significant proportion of neonates who developed hearing loss associated with infection. Three cost-effectiveness evaluations concluded that universal newborn screening for cCMV was cost-effective when compared to targeted newborn screening or no screening. None of these analyses were specific to the Canadian context. While 1 of 3 evidence-based guidelines identified by this review makes a recommendation favouring universal newborn screening for cCMV, 2 evidence-based guidelines recommend against the implementation of universal newborn screening for cCMV (including 1 from the Canadian context), generally citing a lack of sufficient clinical evidence. What Does This Mean? The included cost-effectiveness studies and evidence-based guidelines in this report emphasize that limited clinical evidence is currently available to inform decision-making concerning newborn screening for cCMV. Jurisdictions where universal newborn screening for cCMV has been implemented provide an opportunity for clinical research to support and inform future decision-making. The current limitation of available clinical data describing newborn screening for cCMV will require decision-makers to draw from a broader set of inputs and sources than those available from empirical studies.

Promoting equality, diversity and inclusion in research and funding: reflections from a digital manufacturing research network

BackgroundEqual, diverse, and inclusive teams lead to higher productivity, creativity, and greater problem-solving ability resulting in more impactful research. However, there is a gap between equality, diversity, and inclusion (EDI) research and practices to create an inclusive research culture. Research networks are vital to the research ecosystem, creating valuable opportunities for researchers to develop their partnerships with both academics and industrialists, progress their careers, and enable new areas of scientific discovery. A feature of a network is the provision of funding to support feasibility studies – an opportunity to develop new concepts or ideas, as well as to ‘fail fast’ in a supportive environment. The work of networks can address inequalities through equitable allocation of funding and proactive consideration of inclusion in all of their activities.MethodsThis study proposes a strategy to embed EDI within research network activities and funding review processes. This paper evaluates 21 planned mitigations introduced to address known inequalities within research events and how funding is awarded. EDI data were collected from researchers engaging in a digital manufacturing network activities and funding calls to measure the impact of the proposed method.ResultsQuantitative analysis indicates that the network’s approach was successful in creating a more ethnically diverse network, engaging with early career researchers, and supporting researchers with care responsibilities. However, more work is required to create a gender balance across the network activities and ensure the representation of academics who declare a disability. Preliminary findings suggest the network’s anonymous funding review process has helped address inequalities in funding award rates for women and those with care responsibilities, more data are required to validate these observations and understand the impact of different interventions individually and in combination.ConclusionsIn summary, this study offers compelling evidence regarding the efficacy of a research network's approach in advancing EDI within research and funding. The network hopes that these findings will inform broader efforts to promote EDI in research and funding and that researchers, funders, and other stakeholders will be encouraged to adopt evidence-based strategies for advancing this important goal.

Exploring patient and staff member views on a 'consent for contact' system for sexual health research: A mixed methods study.

Recruitment in sexual health research is challenging. This study explores the potential of a Consent for Contact system (C4C) - generic consent for research contact - to improve participant recruitment and engagement in sexual health research. Our objectives were to understand patient and staff understanding of research, their views on a separate C4C system, and their preferences for its acceptability in a sexual health clinic setting. A two-stage study was conducted at a large urban UK sexual health clinic from November 2021 to July 2022. Stage one involved a self-completed questionnaire administered to all patients and staff. In Stage 2, semi-structured interviews (SSIs) further explored patient concerns and preferences. Survey data were analysed using chi-square and Fisher's exact test and thematic analysis was applied to free-text responses and SSIs. A total of 205/300 patient (68%) and 41/280 staff questionnaires (15%) were completed. Motivations for research participation included altruism and personal interest. Statistically significant differences were found between patients' and staff members' concerns on confidentiality and anticipated feeling of pressure to participate. The majority of staff (n = 38, 93%) and half of patients (n = 100, 49%) supported implementation of a sexual health C4C system. Participants recognised the potential benefits of a sexual health C4C system, including enhanced privacy and increased research opportunities. Concerns were raised about stigma, terminology, and signing-up methods. This study found the C4C system has the potential to enhance participant recruitment and engagement in sexual health research, but implementation support is narrowly divided with concerns around privacy and sign-up processes. These insights call for a patient-centred design approach, emphasising clear communication and privacy. Future research should focus on implementing and evaluating a sexual health C4C system to further explore their effectiveness and acceptability in different contexts.