Visual Research Articles

Positron Emission Tomography Fluorodeoxyglucose Correlates to Symptomatic Optic Tract Compression From Internal Carotid Artery Dolichoectasia That Progressed to Higher Cortical Visual Dysfunction.

Positron Emission Tomography Fluorodeoxyglucose Correlates to Symptomatic Optic Tract Compression From Internal Carotid Artery Dolichoectasia That Progressed to Higher Cortical Visual Dysfunction.

Dental Color-Matching Ability: Comparison between Visual Determination and Technology.

The choice of the correct color is of paramount importance in esthetic dentistry; however, there is still no consensus on the best technique to determine it. The aim of the present study is to compare the accuracy of a recently introduced colorimeter in shade matching with human vision. In addition, possible variables affecting color-matching by human eye have been analysed. 18 disc-shaped composite samples with identical size and shape were produced from a composite flow system (Enamel plus HriHF, Micerium): Nine were considered control samples (UD 0-UD 6), and nine were test samples with identical flow composite shade to the control ones. Parallelly, 70 individuals (dental students and dental field professionals) were individually instructed to sit in a dark room illuminated with D55 light and to perform visual shade matching between control and test discs. An error matrix containing ΔE94 between control and test discs was generated, containing four match-clusters depending on perceptibility and acceptability thresholds. The frequency and severity of errors were examined. The colorimeter achieved a 100% perfect matching, while individuals only achieved a 78%. A higher occurrence of mismatches was noted for intermediate composite shades without a statistically significant difference. No statistically significant differences were reported for age, sex, and experience. A statistically significant difference was present among the Optishade match and the visual determination. The instrumental shade-matching evaluation proved to be significantly more reliable than the human visual system. Further research is needed to determine whether the same outcomes are achieved in a clinical setting directly on patients.

ORB Visual and WiFi Online RSSI fusion SLAM

Simultaneous Localization and Mapping (SLAM) technologies are indispensable for indoor service robots, enabling them to navigate through and interact with environments. Visual SLAM systems often encounter significant challenges such as dynamic obstacles, variable lighting, feature scarcity, and perceptual aliasing in real-world scenarios. By merging the precise environmental mapping capabilities of visual SLAM with the ubiquity and stability of WiFi signals, our method effectively addresses the limitations typically associated with visual SLAM. Notably, our fusion technique leverages existing WiFi infrastructure, thus providing a cost-effective improvement in spatial awareness without the extensive offline database requirements of WiFi RSSI-based localization. Comparative performance evaluations highlight that our graph optimization-based approach not only surpasses the original ORBSLAM3 method but also significantly outperforms the Extended Kalman Filter (EKF) in terms of accuracy, particularly in environments characterized by poor lighting, feature-less scenes, and significant occlusions. This is evidenced by a reduced Root Mean Square Error (RMSE) in localization: 3.09m for our method versus 4.02m for EKF. This enhancement in precision underscores the potential of our integrated system to advance indoor navigation technologies, making it a crucial development in the field of robotics and automated systems.

Compact binocular holographic near-eye 3D display system based on a liquid crystal polarization grating

Holographic technology is considered as one of the most ideal 3D display technologies and has significant potential in near-eye display. However, binocular holographic near-eye 3D display still faces challenges such as serious visual fatigue and complex system. Here, we propose a compact binocular holographic near-eye 3D display system based on a liquid crystal polarization grating (LCPG). Based on the LCPG, the reconstructed light can be deflected respectively to left and right viewing areas. The proposed system achieves binocular display with only one phase-only spatial light modulator used to load computer-generated hologram, which makes the binocular display system more compact. Simultaneously, the proposed system reduces mismatches in the images perceived by two eyes, thus achieving a better binocular display effect. Experimental results demonstrate the feasibility of the proposed binocular holographic near-eye 3D display system with dual viewing areas. Additionally, based on the time-division multiplexing method, dynamic binocular holographic near-eye display can be achieved. The proposed system has potential applications in holographic virtual reality and augmented reality display.

Structure-function coupling in highly sampled individual brains.

Structural connectivity (SC) between distant regions of the brain support synchronized function known as functional connectivity (FC) and give rise to the large-scale brain networks that enable cognition and behavior. Understanding how SC enables FC is important to understand how injuries to SC may alter brain function and cognition. Previous work evaluating whole-brain SC-FC relationships showed that SC explained FC well in unimodal visual and motor areas, but only weakly in association areas, suggesting a unimodal-heteromodal gradient organization of SC-FC coupling. However, this work was conducted in group-averaged SC/FC data. Thus, it could not account for inter-individual variability in the locations of cortical areas and white matter tracts. We evaluated the correspondence of SC and FC within three highly sampled healthy participants. For each participant, we collected 78min of diffusion-weighted MRI for SC and 360min of resting state fMRI for FC. We found that FC was best explained by SC in visual and motor systems, as well as in anterior and posterior cingulate regions. A unimodal-to-heteromodal gradient could not fully explain SC-FC coupling. We conclude that the SC-FC coupling of the anterior-posterior cingulate circuit is more similar to unimodal areas than to heteromodal areas.

Development workflow based on in situ synchrotron investigations to optimize laser processing of copper pins

To design future laser manufacturing processes for welding of copper materials, more and more high-end analysis methods are required. A fundamental process understanding by analyzing cause-and-effect relations of process dynamics using inline in situ diagnostics allows for an improved description of laser material interaction. Strategies for a reliable and robust welding process are derived from the findings. In this study, a four-step advanced methodical approach is presented and discussed. In the first step, a fundamental process description of the geometry of the vapor capillary and the formation of weld defects is developed. Therefore, welds on electrolytic tough pitch copper (Cu-ETP) and CuSn6 are carried out to analyze the temporal and spatial vapor capillary dynamics depending on laser power, welding speed, and focal diameter. This fundamental process understanding is transferred to the welding of copper pins in the form of I-pins. For this purpose, impurities and imperfections were applied to the pin surface to investigate the effects on the process result. As a third step, strategies by means of laser intensity distributions were adapted to compensate for imperfections in the welding process. Finally, a sensor vision system is adapted for ideal welding results. Investigations are based on in situ synchrotron analysis at Petra III, DESY in Hamburg. For the experiments, a TRUMPF TruDisk laser (100/400 μm fiber diameter), a TRUMPF TruFiber 6000P (50/100 μm fiber diameter), and a single-mode fiber laser (14 μm fiber diameter) were used. The focal diameter was adjusted with the optical system depending on the investigation.

In Vivo Visualization of Intravascular Patrolling Immune Cells in the Primate Eye.

Insight into the immune status of the living eye is essential as we seek to understand ocular disease and develop new treatments. The nonhuman primate (NHP) is the gold standard preclinical model for therapeutic development in ophthalmology, owing to the similar visual system and immune landscape in the NHP relative to the human. Here, we demonstrate the utility of phase-contrast adaptive optics scanning light ophthalmoscope (AOSLO) to visualize immune cell dynamics on the cellular scale, label-free in the NHP. Phase-contrast AOSLO was used to image preselected areas of retinal vasculature in five NHP eyes. Images were registered to correct for eye motion, temporally averaged, and analyzed for immune cell activity. Cell counts, dimensions, velocities, and frequency per vessel were determined manually and compared between retinal arterioles and venules. Based on cell appearance and circularity index, cells were divided into three morphologies: ovoid, semicircular, and flattened. Immune cells were observed migrating along vascular endothelium with and against blood flow. Cell velocity did not significantly differ between morphology or vessel type and was independent of blow flood. Venules had a significantly higher cell frequency than arterioles. A higher proportion of cells resembled "flattened" morphology in arterioles. Based on cell speeds, morphologies, and behaviors, we identified these cells as nonclassical patrolling monocytes (NCPMs). Phase-contrast AOSLO has the potential to reveal the once hidden behaviors of single immune cells in retinal circulation and can do so without the requirement of added contrast agents that may disrupt immune cell behavior.

Motion Prediction and Object Detection for Image-Based Visual Servoing Systems Using Deep Learning

This study primarily investigates advanced object detection and time series prediction methods in image-based visual servoing systems, aiming to capture targets better and predict the motion trajectory of robotic arms in advance, thereby enhancing the system’s performance and reliability. The research first implements object detection on the VOC2007 dataset using the Detection Transformer (DETR) and achieves ideal detection scores. The particle swarm optimization algorithm and 3-5-3 polynomial interpolation methods were utilized for trajectory planning, creating a unique dataset through simulation. This dataset contains randomly generated trajectories within the workspace, fully simulating actual working conditions. Significantly, the Bidirectional Long Short-Term Memory (BILSTM) model was improved by substituting its traditional Multilayer Perceptron (MLP) components with Kolmogorov–Arnold Networks (KANs). KANs, inspired by the K-A theorem, improve the network representation ability by placing learnable activation functions on fixed node activation functions. By implementing KANs, the model enhances parameter efficiency and interpretability, thus addressing the typical challenges of MLPs, such as the high parameter count and lack of transparency. The experiments achieved favorable predictive results, indicating that the KAN not only reduces the complexity of the model but also improves learning efficiency and prediction accuracy in dynamic visual servoing environments. Finally, Gazebo software was used in ROS to model and simulate the robotic arm, verify the effectiveness of the algorithm, and achieve visual servoing.

From Cats to the Cortex: Unravelling the Hierarchical Processing System of Vision and Brain Plasticity.

The groundbreaking research conducted by neurophysiologists David Hubel and Torsten Wiesel during the late 1950s and 1960s revolutionized the field of visual neuroscience. Through single-unit recordings in the visual cortex of cats, they made several key discoveries that fundamentally changed our understanding of visual processing. Their work introduced the concept of orientation selectivity, revealing that neurons in the visual cortex are specifically tuned to line orientations, thereby illustrating how the brain constructs visual representations through edge detection. Additionally, they discovered ocular dominance columns, the specialized cortical regions that respond preferentially to input from one eye, providing crucial insights into the organization of visual processing and the importance of binocular vision. Hubel and Wiesel's research also established the concept of a critical period in visual development, demonstrating that early visual experiences are essential for the proper maturation of the visual system. This discovery has had significant implications for understanding neural plasticity and the role of sensory input in neural development. The impact of their work goes beyond theoretical knowledge, contributing to the development of therapeutic strategies for some visual disorders and guiding current research into brain plasticity and visual processing. This review synthesizes the monumental contributions of Hubel and Wiesel, evaluating how their key discoveries have shaped subsequent research in visual neuroscience. It traces the evolution of knowledge related to visual pathways, feature detection, and brain plasticity, highlighting the enduring influence of their foundational work on contemporary studies. By exploring the progression from their pioneering findings to modern advancements, this review emphasizes the legacy of Hubel and Wiesel's contributions to our understanding of vision and neural function.

Intelligent Framework Design for Quality Control in Industry 4.0

This research aims to develop an intelligent framework for quality control and fault detection in pre-production and post-production systems in Industry 4.0. In the pre-production system, the health of the manufacturing machine is monitored. In this study, we examine the gear system of induction motors used in industries. In post-production, the product is tested for quality using a machine vision system. Gears are fundamental components in countless mechanical systems, ranging from automotive transmissions to industrial machinery, where their reliable operation is vital for overall system efficiency. A faulty gear system in the induction motor directly affects the quality of the manufactured product. Vibration data, collected from the gear system of the induction motor using vibration sensors, are used to predict the motor’s health condition. The gear system is monitored for six different fault conditions. In the second part, the quality of the final product is inspected with the machine vision system. Faults on the surface of manufactured products are detected, and the product is classified as a good or bad product. The quality control system is developed with different deep learning models. Finally, the quality control framework is validated and tested with the evaluation metrics.

3D versus 4K laparoscopic vaginal cuff closure after hysterectomy by surgeons in training: a prospective randomised trial.

Technological advances in visual systems have contributed to overcoming the limitations in spatial perception of minimally invasive techniques. To date, there is a lack of literature on the advantages of 3D vision systems over 4K in laparoscopic surgery, although benefits have been observed in the training setting. To compare operating times, perioperative outcomes, and task achievement using 3D and 4K vision systems for vaginal cuff closure performed by residents during total laparoscopic hysterectomy (TLH). All surgeons in training have obtained the Gynaecological Endoscopic Surgical Education and Assessment (GESEA) certificate. This is a prospective randomised trial (NCT04637022). Women undergoing total hysterectomies for benign conditions between January 2021 and November 2023 were enrolled in the study. Vaginal cuff closures were performed by surgeons in training who had obtained the second level of the GESEA programme certificate. Fifty-four patients were enrolled. There were no statistically significant differences in time between 3D and 4K vision for vaginal cuff closure (p=0.918). No statistically significant differences were observed for mean estimated blood loss (EBL) (overall: 62.85 ± 22.73mL; 3D: 65 ± 24.83mL; 4K: 61.11 ± 21.18; p=0.556) and median hospital stay (p=0.234). Three non-severe intraoperative complications in the 3D group (p=0.048) and three postoperative complications in the entire cohort (p=0.685) were reported. The operating time for vaginal cuff closure performed by trainee surgeons is similar when comparing 3D vision during conventional laparoscopy and 4K vision systems. The choice of surgical vision systems may be guided by a cost analysis and surgeon preferences. Substantial evidence is lacking regarding the advantages of incorporating 3D vision into standard laparoscopy for gynaecological surgery. This research seeks to assess whether the 3D visual system can provide benefits as compared to 4K visualisation during laparoscopic vaginal cuff closure performed by surgeons in training within the GESEA 2 certification programme.

Spatial attention for human-centric visual understanding: An Information Bottleneck method

The selective visual attention mechanism in the Human Visual System (HVS) restricts the amount of information that reaches human visual awareness, allowing the brain to perceive high-fidelity natural scenes in real-time with limited computational cost. This selectivity acts as an “Information Bottleneck (IB)” that balances information compression and predictive accuracy. However, such information constraints are rarely explored in the attention mechanism for deep neural networks (DNNs). This paper introduces an IB-inspired spatial attention module for DNNs, which generates an attention map by minimizing the mutual information (MI) between the attentive content and the input while maximizing that between the attentive content and the output. We develop this IB-inspired attention mechanism based on a novel graphical model and explore various implementations of the framework. We show that our approach can yield attention maps that neatly highlight the regions of interest while suppressing the backgrounds, and are interpretable for the decision-making of the DNNs. To validate the effectiveness of the proposed IB-inspired attention mechanism, we apply it to various computer vision tasks including image classification, fine-grained recognition, cross-domain classification, semantic segmentation, and object detection. Extensive experiments demonstrate that it bootstraps standard DNN structures quantitatively and qualitatively for these tasks.

What Do We Mean When We Say "Insight"? A Formal Synthesis of Existing Theory.

Researchers have derived many theoretical models for specifying users' insights as they interact with a visualization system. These representations are essential for understanding the insight discovery process, such as when inferring user interaction patterns that lead to insight or assessing the rigor of reported insights. However, theoretical models can be difficult to apply to existing tools and user studies, often due to discrepancies in how insight and its constituent parts are defined. This article calls attention to the consistent structures that recur across the visualization literature and describes how they connect multiple theoretical representations of insight. We synthesize a unified formalism for insights using these structures, enabling a wider audience of researchers and developers to adopt the corresponding models. Through a series of theoretical case studies, we use our formalism to compare and contrast existing theories, revealing interesting research challenges in reasoning about a user's domain knowledge and leveraging synergistic approaches in data mining and data management research.

Bio-inspired deep neural local acuity and focus learning for visual image recognition

In the field of computer vision and image recognition, enabling the computer to discern target features while filtering out irrelevant ones poses a challenge. Drawing insights from studies in biological vision, we find that there is a local visual acuity mechanism and a visual focus mechanism in the initial conversion and processing of visual information, ensuring that the visual system can give ear to salient features of the target in the early visual observation phase. Inspired by this, we build a novel image recognition network to focus on the target features while ignoring other irrelevant features in the image, and further focus on the focus features based on the target features. Meanwhile, in order to comply with the output characteristics when similar features exist in different categories, we design a softer image label operation for similar features in different categories, which solves the correlation of labels between categories. Relevant experimental findings underscore the efficacy of our proposed method, revealing discernible advantages in comparison to alternative approaches. Visualization results further attest to the method’s capability to selectively focus on pertinent target features within the image, sidelining extraneous information.

The sodium-bicarbonate cotransporter Slc4a5 mediates feedback at the first synapse of vision.

Feedback at the photoreceptor synapse is the first neuronal circuit computation in vision, which influences downstream activity patterns within the visual system. Yet, the identity of the feedback signal and the mechanism of synaptic transmission are still not well understood. Here, we combined perturbations of cell-type-specific genes of mouse horizontal cells with two-photon imaging of the result of light-induced feedback in cones and showed that the electrogenic bicarbonate transporter Slc4a5, but not the electroneutral bicarbonate transporter Slc4a3, both expressed specifically in horizontal cells, is necessary for horizontal cell-to-cone feedback. Pharmacological blockage of bicarbonate transporters and buffering pH also abolished the feedback but blocking sodium-proton exchangers and GABA receptors did not. Our work suggests an unconventional mechanism of feedback at the first visual synapse: changes in horizontal cell voltage modulate bicarbonate transport to the cell, via Slc4a5, which leads to the modulation of feedback to cones.

The neural circuit of Superior colliculus to ventral tegmental area modulates visual cue associated with rewarding behavior in optical intracranial Self-Stimulation in mice

Visual system is the most important system of animal to cognize the information in outside world, and reward-related visual cues are the key factors in the consolidation and retrieval of reward memory. However, the neural circuit mechanism is still unclear. Superior Colliculus (SC) receive direct input from the retina and belong to the earliest stages of visual processing. Recent studies identified a specific pathway from SC to ventral tegmental area (VTA) that underlie specific innate behaviors, eg. flight or freezing, approach behaviors and so on. In present research, we investigated that inhibition of SC to VTA circuit with chemogenetics suppressed light cue-associated reward-seeking behaviors, while activation of the SC-VTA circuit with optogenetics technology triggered the reward-seeking behaviors in optical intracranial self-stimulation for VTA DA neurons (oICSS) in mice. These findings suggest that neural circuit of SC-VTA mediates the retrieval of reward memory associated with visual cues, which will provide a new field for revealing the neural mechanism of pathological memory such as addiction.

Learning to segment self-generated from externally caused optic flow through sensorimotor mismatch circuits

Efficient sensory detection requires the capacity to ignore task-irrelevant information, for example when optic flow patterns created by egomotion need to be disentangled from object perception. To investigate how this is achieved in the visual system, predictive coding with sensorimotor mismatch detection is an attractive starting point. Indeed, experimental evidence for sensorimotor mismatch signals in early visual areas exists, but it is not understood how they are integrated into cortical networks that perform input segmentation and categorization. Our model advances a biologically plausible solution by extending predictive coding models with the ability to distinguish self-generated from externally caused optic flow. We first show that a simple three neuron circuit produces experience-dependent sensorimotor mismatch responses, in agreement with calcium imaging data from mice. This microcircuit is then integrated into a neural network with two generative streams. The motor-to-visual stream consists of parallel microcircuits between motor and visual areas and learns to spatially predict optic flow resulting from self-motion. The second stream bidirectionally connects a motion-selective higher visual area (mHVA) to V1, assigning a crucial role to the abundant feedback connections to V1: the maintenance of a generative model of externally caused optic flow. In the model, area mHVA learns to segment moving objects from the background, and facilitates object categorization. Based on shared neurocomputational principles across species, the model also maps onto primate visual cortex. Our work extends Hebbian predictive coding to sensorimotor settings, in which the agent actively moves - and learns to predict the consequences of its own movements.

Retinal damage promotes mitochondrial transfer in the visual system of a mouse model of Leber hereditary optic neuropathy.

Lenadogene nolparvovec is a gene therapy which has been developed to treat Leber hereditary optic neuropathy (LHON) caused by a point mutation in the mitochondrial NADH dehydrogenase 4 (ND4) gene. Clinical trials have demonstrated a significant improvement of visual acuity up to 5 years after treatment by lenadogene nolparvovec but, surprisingly, unilateral treatment resulted in bilateral improvement of vision. This contralateral effect - similarly observed with other gene therapy products in development for MT-ND4-LHON - is supported by the migration of viral vector genomes and their transcripts to the contralateral eye, as reported in animals, and post-mortem samples from two patients. In this study, we used an AAV2 encoding fluorescent proteins targeting mitochondria to investigate whether these organelles themselves could transfer from the treated eye to the fellow one. We found that mitochondria travel along the visual system (optic chiasm and primary visual cortex) and reach the contralateral eye (optic nerve and retina) in physiological conditions. We also observed that, in a rotenone-induced model of retinal damage mimicking LHON, mitochondrial transfer from the healthy to the damaged eye was accelerated and enhanced. Our results thus provide a further explanation for the contralateral beneficial effect observed during clinical studies with lenadogene nolparvovec.

MixFuse: An iterative mix-attention transformer for multi-modal image fusion

Multi-modal image fusion plays a crucial role in various visual systems. However, existing methods typically involve a multi-stage pipeline, i.e., feature extraction, integration, and reconstruction, which limits the effectiveness and efficiency of feature interaction and aggregation. In this paper, we propose MixFuse, a compact multi-modal image fusion framework based on Transformers. It smoothly unifies the process of feature extraction and integration, As its core, the Mix Attention Transformer Block (MATB) integrates the Cross-Attention Transformer Module (CATM) and the Self-Attention Transformer Module (SATM). The CATM introduces a symmetrical cross-attention mechanism to identify modality-specific and general features, filtering out irrelevant and redundant information. Meanwhile, the SATM is designed to refine the combined features via a self-attention mechanism, enhancing the internal consistency and proper preservation of the features. This successive cross and self-attention modules work together to enhance the generation of more accurate and refined feature maps, which are essential for later reconstruction. Extensive evaluation of MixFuse on five public datasets shows its superior performance and adaptability over state-of-the-art methods. The code and model will be released at https://github.com/Bitlijinfu/MixFuse.

Treatment plan quality for stereotactic treatment of multiple cranial metastases: Comparison of C-arm and O-ring treatment platforms

C-arm linacs have been used widely to treat multiple cranial metastases using stereotactic radiosurgery (SRS). A new generation of O-ring linacs offer several workflow advantages when compared to C-arm platforms. However, O-ring linacs are not able to employ couch rotations for noncoplanar beams used in SRS treatments. This study was conducted in order to simulate further possible developments of O-ring treatment units by assessing their geometrical efficiency. In this work we compare the plan quality for C-arm versus an O-ring platform including metrics that are relevant to SRS for multiple metastases. The comparison is conducted by incorporating tilted arcs on the O-ring platform therefore introducing noncoplanarity.Total 40 patients previously treated for SRS with 20 Gy single fraction were replanned for C-arm with a standard noncoplanar 5-arc arrangement and O-ring with both coplanar and noncoplanar beams. For the O-ring plans, we considered a default 3-arc coplanar arrangement, as well as 3- and 5-arc arrangements with arcs tipped up to 10 degrees from the axial plane. Target coverage, organ-at-risk (OAR) doses, monitor unit (MU) efficiency, conformity and gradient indices were assessed for all plans.For most metrics the O-ring geometries, even the coplanar arrangement, produced statistically comparable results to the C-arm. Small but significant differences were found for the 3 arc O-ring for PTV: D90%, D2% and MU/Gy and for the 5 arc O-ring at D2% when both were compared to the C-arm. Cumulative dose volume histograms (DVHs) for normal brain showed a cross-over between the C-arm and coplanar O-ring geometry at a low dose (2.3 ± 1.8 Gy), with O-ring associated with higher volumes above this cross-over dose. However, no statistical difference was seen in the brainstem, optic pathway and volumes of normal brain receiving 12 Gy or 20 Gy.This study has found that O-ring geometry linacs can produce SRS plans of comparable quality to those from a C-arm for multiple cranial metastases.