Depth Information Research Articles

Inhibition of return in a 3D scene depends on the direction of depth switch between cue and target.

Inhibition of return (IOR) is a phenomenon that reflects slower target detection when the target appears at a previously cued rather than uncued location. In the present study, we investigated the extent to which IOR occurs in three-dimensional (3D) scenes comprising pictorial depth information. Peripheral cues and targets appeared on top of 3D rectangular boxes placed on the surface of a textured ground plane in virtual space. When the target appeared at a farther location than the cue, the magnitude of the IOR effect in the 3D condition remained similar to the values found in the two-dimensional (2D) control condition (IOR was depth-blind). When the target appeared at a nearer location than the cue, the magnitude of the IOR effect was significantly attenuated (IOR was depth-specific). The present findings address inconsistencies in the literature on the effect of depth on IOR and support the notion that visuospatial attention exhibits a near-space advantage even in 3D scenes consisting entirely of pictorial depth information.

Map construction algorithm based on dense point cloud

AbstractIn order to address the issue of the difficulty in constructing maps from sensor‐acquired point clouds, a map construction algorithm is proposed for the effective conversion from sparse point clouds to dense point clouds. First, it constructs a dense point cloud map in real‐time using colour and depth information of keyframes. Then, it generates an accurate point cloud map by voxel filtering and coordinate conversion. Finally, the point cloud map is converted into an octree map using OctoMap. This article uses the TUM dataset for simulation analysis to verify the effectiveness of the algorithm. The results demonstrate that the algorithm can construct dense point cloud maps with high positioning accuracy in sparse point cloud scenarios. The algorithm improves the positioning accuracy by more than 15% under the fr1_xyz, fr1_room, fr1_desk2, fr1_desk1, fr2_desk and fr3_str_tex_near sequences, compared to ORB‐SLAM2, ORB‐SLAM3 and GX ORB‐SLAM2 algorithm

Motion Recognition Based on Deep Learning Algorithm

Advanced scientific and technological measurement methods are the basis of sports research and the progress of sports research methods. It promotes the continuous improvement of sports technology to meet athletes’ pursuit of excellent sports achievements. Therefore, the method of sports scientific research must be changed from the traditional empirical training mode to the programmed training method, from the qualitative analysis of the training effect to the nuanced analysis of the training process. Based on this, this paper uses in-depth learning to study sports motion capture. First, two-dimensional human joints are extracted based on Mask R-CNN. Then, the 3D human motion skeleton is constructed by using the binocular vision system, and the Mask R-CNN human pose estimation algorithm is optimized. On this basis, a sports motion capture system is designed, and the system’s accuracy is verified. The error of the depth information obtained by the sports capture system constructed in this paper is less than 3% in the experiment of about 2[Formula: see text]m. It has strong practicability.

Effect of attention on ensemble perception: Comparison between exogenous attention, endogenous attention, and depth.

Ensemble perception is an important ability of human beings that allows one to extract summary information for scenes and environments that contain information that far exceeds the processing limit of the visual system. Although attention has been shown to bias ensemble perception, two important questions remain unclear: (1) whether direct manipulations on different types of spatial attention could produce similar effects on ensembles and (2) whether factors potentially influencing the attention distribution, such as depth perception, could evoke an indirect effect of attention on ensemble representation. This study aims to address these questions. In Experiments 1 and 2, two types of precues were used to evoke exogenous and endogenous attention, respectively, and the ensemble color perceptions were examined. We found that both exogenous and endogenous attention biased ensemble representation towards the attended items, and the latter produced a greater effect. In Experiments 3 and 4, we examined whether depth perception could affect color ensembles by indirectly influencing attention allocation in 3D space. The items were separated in two depth planes, and no explicit cues were applied. The results showed that color ensemble was biased to closer items when depth information was task relevant. This suggests that ensemble perception is naturally biased in 3D space, probably through the mechanism of attention. Computational modeling consistently showed that attention exerted a direct shift on the ensemble statistics rather than averaging the feature values over the cued and noncued items, providing evidence against an averaging process of individual perception.

The effect of the product categories diversity recommended on cross‐buying in electronic commerce platforms: The moderating role of user navigation heterogeneity

AbstractE‐commerce platforms encourage consumers' cross‐buying behavior to boost user traffic and trading volume. However, balancing the precision and richness of recommended information with the mechanisms influencing consumer cross‐buying remains unclear, which also poses challenges to the specific operation of these platforms. Therefore, this study leverages extensive online behavioral data from an e‐commerce platform, encompassing detailed records of 26,034 consumers. By employing unsupervised machine learning algorithms to distinguish the heterogeneity of consumer browsing, we apply clickstream data to explore the mechanisms of the impact of information diversity, specifically the breadth and depth of recommended product categories, on cross‐buying. This study reveals that the effect of diverse recommendations on online decision‐making undergoes marginal variations due to alterations in both the breadth and depth of these recommendations. Specifically, the depth and breadth of recommended product categories exhibit an inverted U‐shaped relationship with cross‐buying, initially promoting, and subsequently suppressing it. Additionally, consumers with different browsing behavior characteristics respond differently to recommendation diversity. Confused visitors and hedonic visitors positively moderate the depth of information and negatively moderate the breadth of recommendations with the inverted U‐shaped effect on cross‐buying. Search‐oriented visitors positively adjust the inverted U‐shaped relationship between the depth of information and the breadth of recommendations on consumer cross‐buying. This study enriches research on cross‐buying in the domain of recommendations on e‐commerce platforms from the perspective of information diversity, providing valuable insights for optimizing recommendation strategies, promoting cross‐buying behavior, and enhancing consumer loyalty.

Real-time volume rendering for three-dimensional fetal ultrasound using volumetric photon mapping

Three-dimensional (3D) fetal ultrasound has been widely used in prenatal examinations. Realistic and real-time volumetric ultrasound volume rendering can enhance the effectiveness of diagnoses and assist obstetricians and pregnant mothers in communicating. However, this remains a challenging task because (1) there is a large amount of speckle noise in ultrasound images and (2) ultrasound images usually have low contrasts, making it difficult to distinguish different tissues and organs. However, traditional local-illumination-based methods do not achieve satisfactory results. This real-time requirement makes the task increasingly challenging. This study presents a novel real-time volume-rendering method equipped with a global illumination model for 3D fetal ultrasound visualization. This method can render direct illumination and indirect illumination separately by calculating single scattering and multiple scattering radiances, respectively. The indirect illumination effect was simulated using volumetric photon mapping. Calculating each photon’s brightness is proposed using a novel screen-space destiny estimation to avoid complicated storage structures and accelerate computation. This study proposes a high dynamic range approach to address the issue of fetal skin with a dynamic range exceeding that of the display device. Experiments show that our technology, compared to conventional methodologies, can generate realistic rendering results with far more depth information.

Adversarial Unsupervised Domain Adaptation for 3D Semantic Segmentation with 2D Image Fusion of Dense Depth

AbstractUnsupervised domain adaptation (UDA) is increasingly used for 3D point cloud semantic segmentation tasks due to its ability to address the issue of missing labels for new domains. However, most existing unsupervised domain adaptation methods focus only on uni‐modal data and are rarely applied to multi‐modal data. Therefore, we propose a cross‐modal UDA on multi‐modal datasets that contain 3D point clouds and 2D images for 3D Semantic Segmentation. Specifically, we first propose a Dual discriminator‐based Domain Adaptation (Dd‐bDA) module to enhance the adaptability of different domains. Second, given that the robustness of depth information to domain shifts can provide more details for semantic segmentation, we further employ a Dense depth Feature Fusion (DdFF) module to extract image features with rich depth cues. We evaluate our model in four unsupervised domain adaptation scenarios, i.e., dataset‐to‐dataset (A2D2 → SemanticKITTI), Day‐to‐Night, country‐to‐country (USA → Singapore), and synthetic‐to‐real (VirtualKITTI → SemanticKITTI). In all settings, the experimental results achieve significant improvements and surpass state‐of‐the‐art models.

Point cloud segmentation method based on an image mask and its application verification

Abstract Accurately perceiving three-dimensional (3D) environments or objects is crucial for the advancement of artificial intelligence (AI) interaction technologies. Currently, various types of sensors are employed to obtain point cloud data for 3D object detection or segmentation tasks. While this multi-sensor approach provides more precise 3D data than monocular or stereo cameras, it is also more expensive. The advent of RGB-D cameras, which provide both RGB images and depth information, addresses this issue.
In this study, we propose a point cloud segmentation method based on image masks. By using an RGB-D camera to capture color and depth images, we generate image masks through object recognition and segmentation. Given the mapping relationship between RGB image pixels and point clouds, these image masks can be further used to extract the point cloud data of the target objects. The experimental results revealed that the average accuracy of target segmentation was 84.78%, which was close to that of PointNet++. Compared with three traditional segmentation algorithms, the accuracy was improved by nearly 23.97%. The running time of our algorithm is reduced by 95.76% compared to the PointNet++ algorithm, which has the longest running time; and by 15.65% compared to the LCCP algorithm, which has the shortest running time among traditional methods. Compared with PointNet++, the segmentation accuracy was improved. This method addressed the issues of low robustness and excessive reliance on manual feature extraction in traditional point cloud segmentation methods, providing valuable support and reference for the accurate segmentation of 3D point clouds.

Automated Weld Path Generation in Cluttered Environments using Segmentation and Iterative Closest Point Workpiece Localization

Abstract A significant amount of manufacturing is performed by small to medium enterprises (SMEs), but these manufacturers often have lower adoption rates of automation. The cost and complexity associated with traditional robot systems slows the adoption of robotic welding operations for SMEs. The recent increase in collaborative robot (cobot) welding systems is bridging the gap however, by reducing the complexity of installing, maintaining and training operators to perform weld operations with cobots. These systems add flexibility in range of operator use and ease of deployment. These systems however still rely on kinematic registration between the robot-mounted torch and workpiece on any open-loop weld. This requires precise placement of the workpiece prior to preforming a weld. This work will discuss a method for part identification and registration in a welding task as a step toward automated weld path generation. The method is based on lower-resolution 3D cameras (RGBD cameras) using a combination of color and depth information. This information is used to both identify the workpiece within a workspace that may have other, non-workpiece items, and then provide registration or localization information of the workpiece within a resolution that could allow follow-on near-position strategies to achieve final weld-path identification.

Vision-Based Localization Method for Picking Points in Tea-Harvesting Robots

To address the issue of accurately recognizing and locating picking points for tea-picking robots in unstructured environments, a visual positioning method based on RGB-D information fusion is proposed. First, an improved T-YOLOv8n model is proposed, which improves detection and segmentation performance across multi-scale scenes through network architecture and loss function optimizations. In the far-view test set, the detection accuracy of tea buds reached 80.8%; for the near-view test set, the mAP0.5 values for tea stem detection in bounding boxes and masks reached 93.6% and 93.7%, respectively, showing improvements of 9.1% and 14.1% over the baseline model. Secondly, a layered visual servoing strategy for near and far views was designed, integrating the RealSense depth sensor with robotic arm cooperation. This strategy identifies the region of interest (ROI) of the tea bud in the far view and fuses the stem mask information with depth data to calculate the three-dimensional coordinates of the picking point. The experiments show that this method achieved a picking point localization success rate of 86.4%, with a mean depth measurement error of 1.43 mm. The proposed method improves the accuracy of picking point recognition and reduces depth information fluctuations, providing technical support for the intelligent and rapid picking of premium tea.

Exploring Factors Affecting Breastfeeding: Insights From Hispanic and Black Mothers and Healthcare Providers in El Paso, Texas

Objective:Breastfeeding has been shown to have many health benefits to both the infant and the mother. However, there are racial and ethnic disparities in breastfeeding rates across all U.S. states and territories. This study sought to understand the support needed to improve breastfeeding rates and address disparities in El Paso County, Texas using the socioecological model framework for analysis.Methods:We conducted focus groups involving 16 Hispanic and Black mothers. During these sessions, we asked them about the environmental and social factors that influenced their decisions to either start or stop breastfeeding. Additionally, we interviewed six health professionals to gain insights into the support activities they provide to breastfeeding women and identify potential gaps in care.Results:The study found several themes that align with prior research on breastfeeding support: (a) Breastfeeding is recognized as being healthy, but misconceptions exist about formula. (b) Some mothers find public breastfeeding or pumping inappropriate, but opinions vary. (c) Family members significantly influence the decision to breastfeed; their support varies. (d) Although aid from healthcare professionals (HCPs) in breastfeeding is appreciated and valued, it is not always available. (e) HCPs are not uniformly perceived as knowledgeable or helpful, occasionally providing conflicting information. (f) Prenatal classes featuring breastfeeding are appreciated, but the depth of information provided varies. (g) Women seek increased postdischarge support from hospitals. (h) The transition back to work introduces various challenges. (i) Community norms and attitudes toward breastfeeding can be unsupportive. (j) Demand exists for updated, accessible local breastfeeding resources. (k) The Special Supplemental Nutrition Program for Women, Infants, and Children is valued, but there is confusion about services and eligibility requirements. (l) Undocumented immigrants might hesitate to access public services due to concerns about their status.Conclusions:Breastfeeding support programs should take into account the cultural context, the influence of healthcare providers, and the availability of community support. Addressing these aspects can be key to promoting breastfeeding and reducing disparities in breastfeeding rates.

Unsupervised Clustering-based 3D Static Scene Construction Using LiDAR Channel and Azimuth Angle

Abstract. Cameras are typically used at road intersections to collect data to perform object detection but struggle in low-light and harsh weather. On the other hand, Light Detection and Ranging (LiDAR) is used as a key technology in 3D vision systems. It gives the 3D point cloud, which includes accurate depth information, but its resolution is cost-dependent, with higher resolutions being more expensive. Deep learning-based method requires large, labelled dataset which increases the cost, time and accuracy depending on the model trained on labelled dataset. To perform object detection in point cloud data is a challenging task due to the incomplete representations, data sparsity and unavailability of training data. To overcome this by using an unsupervised approach, it is important to identify the static scene and then detect the moving object. This work incorporated a novel approach to construct static scene using azimuth angle and laser channel information using an unsupervised clustering approach. This work incorporates two modules I) data collection using VLP-16 LiDAR, and II) static scene construction using DBSCAN (density-based spatial clustering and noise) clustering-based approach. Data is collected at a 4-legged intersection and pre-processed to extract aggregated distances corresponding to the unique pair of azimuth angle and laser channel. DBSCAN is used to perform clustering on the aggregated distances, based on the highest silhouette score and lowest intra distance between points in cluster, static points are identified, and static scene constructed. The qualitative evaluation of method demonstrates that the algorithm effectively and accurately filters out background points.

Assembly method for curved porous circular workpieces based on multidimensional information fusion: Grid electrode component

To tackle the problems related to the complexities of obtaining depth information for circular workpiece with arc surface and holes, a novel vision guidance method has been introduced to precisely gauge interlayer spacing. The process includes the acquisition and preprocessing of point cloud depth information, along with matching and edge processing. The depth coordinates of the point cloud are subsequently determined. Two-dimensional image processing technology is employed to extract the coordinates of the center of the surface circular hole in the curved porous circular workpiece. The 3D coordinates are generated for guiding the assembly by integrating these datasets. Experiments on grid parts in aviation propulsion systems demonstrate that this method maintains dot matrix spacing within 0.5–1.2 mm, ensures the coaxiality of the center hole, and meets assembly standards. The results confirm the method’s effectiveness for automated assembly of curved porous round workpieces.

Analysis Of The Marketing Mix And Its Influence On Purchasing Decisions On The Prasetya Products

This study aims to identify, study and analyze the marketing mix of The Prasetya and The Influences in Customer Decisions to by product of The Prasetya. This study used qualitative research methods, with data collection techniques observation, interviews and explore theh types of open-ended questions where information is free to provide in depth information to be used as research data. The data analyzed is the result of interviews with employees, customers and experienced human resourch of UMKM using analyctical techniques including data reduction, data presentation and levers or cunclusions. The result of this study that marketing mix of The Prasetya has been able to influence consumer purchasing decisions and increase sales turnover and customers always make repeat purchases for the product and also increase the company's profits so that the company's goals can be achieved.

A Depth Awareness and Learnable Feature Fusion Network for Enhanced Geometric Perception in Semantic Correspondence.

Deep learning is becoming the most widely used technology for multi-sensor data fusion. Semantic correspondence has recently emerged as a foundational task, enabling a range of downstream applications, such as style or appearance transfer, robot manipulation, and pose estimation, through its ability to provide robust correspondence in RGB images with semantic information. However, current representations generated by self-supervised learning and generative models are often limited in their ability to capture and understand the geometric structure of objects, which is significant for matching the correct details in applications of semantic correspondence. Furthermore, efficiently fusing these two types of features presents an interesting challenge. Achieving harmonious integration of these features is crucial for improving the expressive power of models in various tasks. To tackle these issues, our key idea is to integrate depth information from depth estimation or depth sensors into feature maps and leverage learnable weights for feature fusion. First, depth information is used to model pixel-wise depth distributions, assigning relative depth weights to feature maps for perceiving an object's structural information. Then, based on a contrastive learning optimization objective, a series of weights are optimized to leverage feature maps from self-supervised learning and generative models. Depth features are naturally embedded into feature maps, guiding the network to learn geometric structure information about objects and alleviating depth ambiguity issues. Experiments on the SPair-71K and AP-10K datasets show that the proposed method achieves scores of 81.8 and 83.3 on the percentage of correct keypoints (PCK) at the 0.1 level, respectively. Our approach not only demonstrates significant advantages in experimental results but also introduces the depth awareness module and a learnable feature fusion module, which enhances the understanding of object structures through depth information and fully utilizes features from various pre-trained models, offering new possibilities for the application of deep learning in RGB and depth data fusion technologies. We will also continue to focus on accelerating model inference and optimizing model lightweighting, enabling our model to operate at a faster speed.

A comparative analysis of face and object perception in 2D laboratory and virtual reality settings: insights from induced oscillatory responses.

In psychophysiological research, the use of Virtual Reality (VR) for stimulus presentation allows for the investigation of how perceptual processing adapts to varying degrees of realism. Previous time-domain studies have shown that perceptual processing involves modality-specific neural mechanisms, as evidenced by distinct stimulus-locked components. Analyzing induced oscillations across different frequency bands can provide further insights into neural processes that are not strictly phase-locked to stimulus onset. This study uses a simple perceptual paradigm presenting images of faces and cars on both a standard 2D monitor and in an immersive VR environment. To investigate potential modality-dependent differences in attention, cognitive load, and task-related post-movement processing, the induced alpha, theta and beta band responses are compared between the two modalities. No evidence was found for differences in stimulus-dependent attention or task-related post-movement processing between the 2D conditions and the realistic virtual conditions in electrode space, as posterior alpha suppression and re-synchronization of centro-parietal beta did not differ between conditions. However, source analysis revealed differences in the attention networks engaged during 2D and 3D perception. Midfrontal theta was significantly stronger in laboratory conditions, indicating higher cognitive load than in the VR environment. Exploratory analysis of posterior theta showed stronger responses in VR, possibly reflecting the processing of depth information provided only by the 3D material. In addition, the theta response seems to be generated by distinct neuronal sources under realistic virtual conditions indicating enhanced involvement of semantic information processing and social cognition.

TAG-fusion: Two-stage attention guided multi-modal fusion network for semantic segmentation

In the current research, leveraging auxiliary modalities, such as depth information or point cloud information, to improve RGB semantic segmentation has shown significant potential. However, existing methods mainly use convolutional modules for aggregating features from auxiliary modalities, thereby lacking sufficient exploitation of long-range dependencies. Moreover, fusion strategies are typically limited to singular approaches. In this paper, we propose a transformer-based multimodal fusion framework to better utilize auxiliary modalities for enhancing semantic segmentation results. Specifically, we employ a dual-stream architecture for extracting features from RGB and auxiliary modalities, respectively. We incorporate both early fusion and deep feature fusion techniques. At each layer, we introduce mixed attention mechanisms to leverage features from other modalities, guiding and enhancing the current modality's features before propagating them to the subsequent stage of feature extraction. After the extraction of features from different modalities, we employ an enhanced cross-attention mechanism for feature interaction, followed by channel fusion to obtain the final semantic features. Subsequently, we provide separate supervision to the network on the RGB stream, auxiliary stream, and fusion stream to facilitate the learning of representations for different modalities. The experimental results demonstrate that our framework exhibits superior performance across diverse modalities. Specifically, our approach achieves state-of-the-art results on the NYU Depth V2, SUN-RGBD, DELIVER and MFNet datasets.

KINERJA PERANGKAT DESA DALAM PENYELENGGARAAN PELAYANAN PUBLIK DI KANTOR DESA PARIJATAH KULON KECAMATAN SRONO KABUPATEN BANYUWANGI

The Performance Of Village Office In The Implementation Of Public Service In Village Office Of Parijatah Kulon Village, Srono District, Banyuwangi Regency. Along with the times, society demands high value public sercices from the government, even though these demands are repeteadly not in line with expectations, because public services have so far been less professional. To improve of service, a performance at the village office cannot work without a village apparture. This improvement in the quality of performance village apparature to save time in fulfilling the functions of village officials and aims to improve the work discipline of an employee works, so that the result obtined are in accordace with thw services ecpected by the community. The research method used in thid study is a qualitative approach, where the research is descriptive in nature which describe the phenomena in the field being studied. For data collection techniques is Observation, Interview, Documentation, and Triangulation. The use of this qualitative method aims to obtain in depth information about the performance of the Parijatah Kulon Village Apparature in the implementation of public services. The performance of this village apparature as invetigated using T.R Mitchell’s theory which has five aspects is quality, promptness, initiative, capability, and communication.

Functional performance comparison of long cane and secondary electronic travel aids for mobility enhancement

This study investigated the impact of secondary electronic travel aids (ETAs) on the mobility performance of individuals with profound visual impairment, specifically focusing on object detection and obstacle avoidance tasks. Seven experienced long-cane users were recruited for the study. The ETAs tested as secondary aids to the long cane included the MiniGuide, utilizing ultrasonic echo location, and the vOICe (Vision-to-Auditory Sensory Substitution Device), which translates visual information into auditory signals. Two software modes of the vOICe were examined: the standard contrast mode and a novel algorithm utilizing relative depth information. Notably, 30 min of familiarization was provided before the trials. Results indicated that while the use of the secondary ETAs led to increased awareness of the surrounding environment, it also resulted in longer processing times and more hesitations, compared with using the long cane alone. Participants demonstrated improved object detection and larger detection and safety ranges during obstacle avoidance. The study also introduced the concept of margin of stability (MoS) as a novel metric for evaluating gait stability while using ETAs. Both MiniGuide and vOICe users exhibited consistent and stable movements, suggesting that these additional aids did not negatively impact overall gait stability. The findings highlight the trade-offs between efficiency and effectiveness when using secondary mobility aids, with longer training periods potentially mitigating these issues. In addition, the study emphasizes the need for ongoing research to optimize the design and training programmes for new ETAs. Future studies may explore the impact of extended training periods on mobility performance. Overall, this research contributes to a deeper understanding of how ETAs can enhance the mobility of individuals with visual impairments while also highlighting some of the challenges associated with their use. Optimizing ETA design and training programmes is crucial for maximizing benefits for individuals with impaired vision.

Dense projection fusion for 3D object detection

Fusing information from LiDAR and cameras can effectively enhance the overall perceptivity of autonomous vehicles in various scenarios. Despite the relatively good results achieved by point-wise fusion and Bird’s-Eye-View (BEV) fusion, they still cannot fully leverage the image information and lack of effective depth information. For any fusion methods, the multi-modal features first need to be concatenated along the channel, and then the fused features are extracted using convolutional layers. However, this type of fusion methods is effective, but too coarse which causes that the fused features cannot pay more attention to the regions with important features and suffer from severe noise. To tackle these issues, we propose in this paper a Dense Projection Fusion (DPFusion) approach. It consists of two new modules: dense depth map guided BEV transform (DGBT) module and multi-modal feature adaptive fusion (MFAF) module. The DGBT module first quickly estimates the depth of each pixel and then projects all image features to the BEV space, making full use of the image information. The MFAF module computes the image weights and point cloud weights for each channel in each BEV grid and then adaptively weights and fuses the image BEV features with the point cloud BEV features. It is worth pointing out that the MFAF module makes the fused features pay more attention to background outline and object outline. Our proposed DPFusion demonstrates competitive results in 3D object detection, achieving a mean Average Precision (mAP) of 70.4 and a nuScenes detection score (NDS) of 72.3 on the nuScenes validation set.