Eye Movement Experiment Research Articles

Element Recognition and Innovation Transformation of Cultural and Creative Products: Based on Eye Movement Experiment

This paper analyzes tourists’ perceived preferences for cultural and creative product elements using human-computer interaction technology and constructs the innovation and transformation path of cultural and creative products from four dimensions: concept, elements, content, and structure. The Great Wall tourism cultural and creative products are used as an example. The findings demonstrate that: (1) From a behavioral data viewpoint, cultural and creative items’ overall inventiveness, formal design, manufacturing method, area, cultural collection value, and function have varying degrees of influence on visitors’ perceived preferences; (2) The richness and attraction of character expression, action, and form components from the hotspot map and matrix map can boost the visual engagement impact of visitors. Scenic area architecture may enhance visitors’ immersion experiences of local culture since it serves as the design prototype for cultural and creative businesses. (3) The number of fixation points, total fixation time, and saccade frequency of cultural and creative products with various design elements differ significantly when viewed from the perspective of the eye movement index, and these differences are further presented as individualized tourist behavior characteristics. (4) From a design standpoint, it is essential that the circumstances of the product satisfy the needs of visitors in order to produce high-quality cultural and creative products. Innovative ideas should be used to steer the innovation and transformation of cultural and creative products, enhancing the universal design of products with element innovation, enhancing the cultural legacies of products with content innovation, and lengthening the market cycle of products with structural innovation. The use of modern technology broadens the research methodologies for the tourism field and creates new research environments for tourism experimentation.

A dynamical scan-path model for task-dependence during scene viewing.

In real-world scene perception, human observers generate sequences of fixations to move image patches into the high-acuity center of the visual field. Models of visual attention developed over the last 25 years aim to predict two-dimensional probabilities of gaze positions for a given image via saliency maps. Recently, progress has been made on models for the generation of scan paths under the constraints of saliency as well as attentional and oculomotor restrictions. Experimental research demonstrated that task constraints can have a strong impact on viewing behavior. Here, we propose a scan-path model for both fixation positions and fixation durations, which include influences of task instructions and interindividual differences. Based on an eye-movement experiment with four different task conditions, we estimated model parameters for each individual observer and task condition using a fully Bayesian dynamical modeling framework using a joint spatial-temporal likelihood approach with sequential estimation. Resulting parameter values demonstrate that model properties such as the attentional span are adjusted to task requirements. Posterior predictive checks indicate that our dynamical model can reproduce task differences in scan-path statistics across individual observers. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Are there preferred viewing locations in Chinese reading? Evidence from eye-tracking and computer simulations.

The Chinese writing system is different from English in that individual words both comprise one to four characters and are not separated by clear word boundaries (e.g., interword spaces). These differences raise the question of how readers of Chinese know where to move their eyes to support efficient lexical processing? The widely accepted default-targeting hypothesis suggests that Chinese readers direct their eyes to a small number of preferred-viewing locations (PVLs), such as the beginning or middle of upcoming words. In this article, we report two eye-movement experiments testing this hypothesis. In both experiments, participants read sentences comprising entirely two-character words, but either without (Experiment 1) or with (Experiment 2) explicit knowledge of this structure prior to their participation. The results of both experiments indicate the absence of PVLs. Simulations using implemented versions of a simple oculomotor-based hypothesis, two variants of the default-targeting hypothesis, and the hypothesis that saccade lengths are modulated as a function of estimated parafoveal-processing difficulty (i.e., dynamic-adjustment hypothesis) suggest that the latter provides the best account of saccadic-targeting during Chinese reading. These results are discussed in relation to broader issues of eye-movement control during reading and how models of such must be modified to provide more accurate accounts of the reading of Chinese and other languages. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Kano-QFD-based analysis of the influence of user experience on the design of handicraft intangible cultural heritage apps

Mobile internet and digital technology provide new media platforms for the dissemination of handicraft intangible cultural heritage (ICH). Despite extensive research into the effect of user experience (UX) on handicraft ICH applications (apps), there is little quantitative research on the relationship between user needs and app design requirements. This study employed semi-structured interviews, online questionnaire surveys, and expert evaluation to understand and rank user needs and design requirement influencing factors. A quantitative analysis using the Kano-QFD approach revealed the different effects of twelve user needs and twenty-three design requirements on handicraft ICH app design. Following the establishment of a relationship matrix between user needs and design requirements, the app design requirements were ranked according to importance. Furthermore, a concept–category–application UX app design framework was constructed based on an analysis of the importance of design requirements. The concept layer formed the theoretical basis for the UX app design, the category layer represented the different facets of the UX design, and the application layer provided specific suggestions on the importance of app design. The eye-movement experiment and System Usability Scale were used to test the UX effects of a sample handicraft ICH app, verifying that the UX design framework was reliable. The framework provides methodological reference for the UX design of other ICH digital products.

How information within the perceptual span guides visual search and aids perception

We explore the guiding effect of task-related information appearing within the perceptual span on visual search based on elements such as the range of effective information attention within the perceptual span and the orientation of task-related objects. In the first experiment, we recorded reaction time and eye movement data of 48 subjects performing a visual search task for target information in the navigation interface and divided them into four experimental groups according to the perceptual span (within or outside the range) and orientation (left or right) of the task-related information. The experimental results showed that: (a) task-related information appearing within the perceptual span had a guiding effect on target search; and (b) the right side closer to the target in task search have better performance in guiding. In the second experiment, eye-movement experiments of the navigation interface based on the eye-movement processing theoretical model of linguistics showed that: (a) within the perceptual span, the shifting of attention causing eye movements (saccade) and brings gaze into the area of interest, and (b) the perceptual span moves with attention shifts. This study provides evidence for cognitive processing of information responses within the perceptual span and dynamic adjustment of perceptual span location and provides a reliable method for effective information presentation and visual layout in navigation interfaces, with a view to providing reference and learning for related studies.

AI-Based Environmental Color System in Achieving Sustainable Urban Development

Confronting the age of artificial intelligence, exploring art through technology has become one of the directions of interdisciplinary development. Not only does artificial intelligence technology explore sustainability on a technical level; it can also take advantage of itself to focus on the visual perception of the living environment. People frequently interpret environmental features through their eyes, and the use of intuitive eye-tracking can provide effective data that can contribute to environmental sustainability in managing the environment and color planning to enhance the image of cities. This research investigates the visual responses of people viewing the historic city of Macau through an eye movement experiment to understand how the color characteristics of the physical environment are perceived. The research reveals that the buildings and plantings in the historic district of Macau are the most visible objects in the environment, while the smaller scale of St. Dominic’s Square, the Company of Jesus Square, and St. Augustine’s Square, which have a sense of spatial extension, have also become iconic environmental landscapes. This also draws visual attention and guides the direction of travel. The overall impressions of the Historic Centre of Macau, as expressed by the participants after the eye movement experiment, were mainly described as “multiculturalism”, “architectural style”, “traditional architecture”, “color scheme”, and “garden planting”. The 60 colors representing the urban color of Macau are then organized around these deep feelings about the environment. Therefore, for future inspiration, the 60 colors can be applied through design practice to create color expressions that fit the local characteristics, and thereby enhance the overall visual image of the city.

Effects of urban waterfront park landscape elements on visual behavior and public preference: Evidence from eye-tracking experiments

High-quality urban blue-green spaces are essential to enhance the well-being of residents. Public preferences in urban landscapes are closely related to visual behavior and can meet human needs. By combining objective eye-movement data with subjective evaluation data, public preferences for blue-green typical spatial waterfront parks were analyzed based on visual behavior. Taking Wuhan, a megacity in China, as an example, four types of landscapes were identified: waterscape, plantscape, hardscape, and integrated landscape. Using visual clustering to identify eye movement indicators, we analyzed the influence of element types, proportions and combinations on public preferences based on visual behavior differences related to landscape elements. The results indicated that: (1) visual behaviors differ among elements and preferences, arbor commands overall attention, and pavilion is the element attended to first. (2) The positive correlation between water and fatigue recovery increased by 0.163 after combination with reflection, while the correlation between arbor and fatigue recovery changed from 0.353 (p < 0.01) to − 0.251 (p < 0.01) after combination with shrub and grass. (3) Plantscape and waterscape were rated as more natural, intimate, and restorative, but the most element-rich integrated landscape had the highest beauty ratings. Hardscape had significantly lower ratings but were generally considered to be fully utilized spaces. (4) The most significant visual behavior factor affecting evaluations was fixation duration, and the most critical landscape elements were arbor and pavilion. This study reveals differences in people's visual perceptions and preferences for waterfront parks through eye-movement experiments, and could lead to more judicious landscape element selections and park space compositions.

Bionic Design Model for Co-creative Product Innovation Based on Deep Generative and BID

Bio-inspired design (BID) is an abstract process, if we can visualize the process of fusing abstract biological inspiration with figurative product shapes, and combine it with artificial intelligence technology to express the designer’s creativity, it will greatly improve the efficiency and accuracy of product shape bionic design. To address this problem, we combine BID with deep generative (DG) model to build a co-creative deep generative bio-inspired design (DGBID) model. Firstly, the designers used perceptual engineering and eye-movement experiments to select the bionic creature that best fits the bionic product and the suitable bionic product and bionic image, respectively. Then, the images are embedded into the potential space of StyleGAN, and the potential relationship between the two is visualized using StyleGAN’s image morphing technique, which generates a new bionic fusion scheme. Finally, the contour lines of the solution are extracted as a reference, the designer is involved in the optimization of the scheme as a sketch, and the hand-drawn sketch is transformed into a real product solution using style migration techniques. The entire bionic design experiment process is a co-creative approach with artificial intelligence technology as the lead and designer participation. The feasibility of the method is verified using the side view of a car as a bionic product. The results show that the integration of bionic technology with deep generative model technology can accelerate the innovation and development of bionic products and provide designers with design references and rapid-generation tools.

The Adjustment of Complexity on Sarcasm Processing in Chinese: Evidence from Reading Time Indicators

It is controversial whether sarcasm processing should go through literal meaning processing. There is also a lack of eye movement evidence for Chinese sarcasm processing. In this study, we used eye movement experiments to explore the processing differences between sarcastic and literal meaning in Chinese text and whether this was regulated by sentence complexity. We manipulated the variables of complexity and literality. We recorded 33 participants' eye movements when they were reading Chinese text and the results were analyzed by a linear mixed model. We found that, in the early stage of processing, there was no difference between the processing time of the sarcastic meaning and the literal meaning of simple remarks, whereas for complex remarks, the time needed to process the sarcastic meaning was longer than that needed to process the literal meaning. In the later stage of processing, regardless of complexity, the processing time of the sarcastic meaning was longer than that of the literal meaning. These results suggest that sarcastic speech processing in Chinese is influenced by literal meaning, and the effect of literal meaning on sarcastic remarks is regulated by complexity. Sarcastic meaning was expressed differently in different stages of processing. These results support the hierarchical salience hypothesis of the serial modular model.

Segmented relations between online reading behaviors, text properties, and reader-text interactions: An eye-movement experiment.

To investigate relations between abilities of readers and properties of words during online sentence reading, we conducted a sentence reading eye-movements study on young adults of English monolinguals from the US, who exhibited a wide scope of individual differences in standard measures of language and literacy skills. We adopted mixed-effects regression models of gaze measures of early and late print processing stages from sentence onset to investigate possible associations between gaze measures, text properties, and skill measures. We also applied segmented linear regressions to detect the dynamics of identified associations. Our study reported significant associations between (a) gaze measures (first-pass reading time, total reading times, and first-pass regression probability) and (b) interactions of lexical properties (word length or position) and skill measures (vocabulary, oral reading fluency, decoding, and verbal working memory), and confirmed a segmented linear dynamics between gaze measures and lexical properties, which was influenced by skill measures. This study extends the previous work on predictive effects of individual language and literacy skills on online reading behavior, enriches the existing methodology exploring the dynamics of associations between lexical properties and eye-movement measures, and stimulates future work investigating factors that shape such dynamics.

Comparison of font size and background color strategies for tag weights on tag maps

ABSTRACT Tag weight differences in tag maps are usually reflected by different font sizes. With this strategy, low weighted tags may be ignored and tag sizes may be misjudged due to differing word length, character height and word width. To address these shortcomings, this paper improves the layout method of tag maps by presetting anchor points. We construct weight contours based on corner points and center points of tag outer envelope rectangles and adopt hypsometric tinting as background color to reflect tag weight differences. Finally, we compare and analyze the background color strategy with the font size strategy from the perspectives of tag selection, tag recognition, tag recall, confidence, readability, and preference through eye movement experiments and questionnaire surveys. The results show that both strategies exhibit advantages (when tags are devoid of semantics), with the font size strategy being favored slightly in this abstract case. We provide tag map designers with a new visualization scheme for the expression of tag weight.

电竞赛车辅助信息栏布局设计——基于眼动实验的研究

电竞赛车辅助信息栏布局设计——基于眼动实验的研究

Modeling and Dynamic Simulation of the Public’s Intention to Reuse Recycled Water Based on Eye Movement Data

The public’s rejection of recycled water has seriously hindered the promotion of recycled water. Individual intention and decision-making behavior will be affected by group decision-making behavior. To clarify the interaction mechanism of the public’s intention to reuse recycled water from the perspective of group decision-making, this study used an eye-movement experiment with a recycled water consumption scenario simulation to obtain the influencing factors and data related to purchase decisions and used the ABM (agent-based modeling) method to simulate the interaction effects of the group’s intention to reuse recycled water in a combination of three influencing factor scenarios: sales volume, quality evaluation, and environmental evaluation on the Netlogo platform. The results showed that (1) quality reviews have a significant effect on the intention of the group to reuse recycled water, followed by sales, and environmental reviews have the worst effect; (2) in the two-factor interaction, the intention of the group to reuse recycled water was significantly improved, and the public’s intention to reuse recycled water was highest under the influence of good quality reviews and high sales; and (3) under the combined influence of the three factors of high sales, good quality reviews, and good environmental reviews, the public’s intention to reuse recycled water was the highest, but the effect was slightly different from the influence of two factors: good quality reviews and high sales. This study aimed to provide a scientific basis for the promotion policy of recycled water reuse.

Influence mechanism of icon semantics on visual search performance: Evidence from an eye-tracking study

Explicit icon semantics can reduce the difficulty of understanding complex visual information. Optimizing the icon semantics and text semantics of icons can effectively improve the cognitive performance of digital interfaces. This paper adopts visual search tasks to study the effects of different combinations of icon semantic familiarity and the presence or absence of text on icon search performance under horizontal and vertical layouts. The behavioral experiment results show that under two layouts: 1. The main effect of icon semantics is significant, and the search performance increases with the increase of semantic familiarity. 2. The main effect of text is significant, and the search performance is negatively correlated with the addition of text. The eye movement experiment found that the semantic familiarity of icons had a significant impact on average fixation time. Furthermore, the number of fixation points changed significantly after the text variable was added. Therefore, there was no significant difference in the number of fixation points in the horizontal layout, and icon semantics was the main influencing factor in visual search. In the vertical layout, there was no significant difference in average fixation time, and text was the main influencing factor of visual search. The results show that the semantic familiarity of icons and different combinations with or without text significantly affect visual search performance in horizontal and vertical layouts. This paper provides a theoretical reference for the combination of icons and text in interface design.

Research into the Visual Saliency of Guide Signs in an Underground Commercial Street Based on an Eye-Movement Experiment

The complex spatial environment of underground commercial street spaces will affect users’ behavior and information needs. As a medium to coordinate the interaction between the underground commercial street space environment and people, guide signs can provide useful information for users. However, the visual saliency of guide signs is the fundamental premise for determining the transmission of information to users. Based on field research, this study identified and examined the factors influencing the significance of guide signs in underground commercial streets from the user’s perspective using the order relation analysis method (G1 method) and with the help of screen-based eye tracking and virtual reality (VR) eye-tracking technology, In addition, we explored the design relationship between critical influencing factors and the space between underground commercial streets, and the visual significance of the differences between each important influencing variable. The study showed that the set position, set height, and design color of underground commercial street guide signs are essential factors in their visual prominence. The prominence was more significant when the position of guide signs was located in the middle and upper area of the space, and the prominence was more significant when the set height was 2.56~2.75 m and 3.12~3.31 m. This study can provide data and theoretical support for the visual saliency design of underground commercial street guide signs and provide a reference for the humanized design of underground commercial street guide signs for public facilities in cities.

Research on the generality of icon sizes based on visual attention

AbstractIcon size is one of the key factors affecting the efficiency of information search. The advent of the era of intelligent interaction has made it difficult for icon design to meet the requirements of noncontact, large information volume, and high precision proposed by natural interaction technology in the future. At the same time, with the continuous improvement of display technology, the display resolution has been increased from 720 P to 8 K. Different sizes of display carriers use different resolutions. In order for icons to have efficient recognition at different display resolutions, it is necessary to obtain the best proportional relationship between icon size and display resolution. This paper summarizes the existing relevant research, calculates the ratio of recommended icon size and display resolution as the research variables, and comprehensively evaluates the recommended optimal ratio range of 1:641–1:334 through eye movement, EEG and behavioral response experiments and entropy‐weight TOPSIS method, providing a reference for icon design in various forms of interactive interfaces in the future.

737 Deep learning methods identify eyelid laxity as the main feature causing the aging look

The aging look has become a widespread concern which could be potentially related to one’s health status and well-being. Previous studies have tried to identify extrinsic and intrinsic risk factors of the aging look. In this study, we focus on the main facial aging signs which caused the aging look. Firstly, by carrying out the eye movement experiment and deep learning visualization in 26 volunteers, we identified orbit is the main region contributing to the aging look. Then, using deep learning methods, we quantified four periorbital aging features (i.e., laxity eyelids, pouch, crow’s feet and lacrimal sulcus) in the Eve cohort (n=255,578).

Research on Image Retrieval Optimization Based on Eye Movement Experiment Data

Satisfying a user's actual underlying needs in the image retrieval process is a difficult challenge facing image retrieval technology. The aim of this study is to improve the performance of a retrieval system and provide users with optimized search results using the feedback of eye movement. We analyzed the eye movement signals of the user’s image retrieval process from cognitive and mathematical perspectives. Data collected for 25 designers in eye tracking experiments were used to train and evaluate the model. In statistical analysis, eight eye movement features were statistically significantly different between selected and unselected groups of images (p &lt; 0.05). An optimal selection of input features resulted in overall accuracy of the support vector machine prediction model of 87.16%. Judging the user’s requirements in the image retrieval process through eye movement behaviors was shown to be effective.

Human–System Interaction Based on Eye Tracking for a Virtual Workshop

With the constant exploration and development of intelligent manufacturing, the concept of digital twins has been proposed and applied. In view of the complexity and intellectualization of virtual workshop systems, real workshops can link with virtual workshosp based on AR under the structure of digital twins, which allows users to interact with virtual information and perceive the virtual information superimposed on the real world with great immersion. However, the three-dimensionality of virtual workshops and interaction with complex workshop information can be challenging for users. Due to a shortage of input bandwidth and the nontraditional mode of interaction, a more natural interaction technique for virtual workshops is required. To solve such problems, this paper presents a technical framework for 3D eye movement interaction applied to a virtual workshop. An eye movement interaction technique, oriented to implicit interaction and explicit interaction, is developed by establishing behavior recognition and interaction intention understanding. An eye-movement experiment verifies the former’s accuracy is above 90% and had better recognition performance. A better feature vector group of the latter is selected to establish a model and verify its feasibility and effectiveness. Finally, the feasibility of the framework is verified through the development of an application example.

Interplay of Message Frame and Reference Point on Recycled Water Acceptance in Green Community: Evidence from an Eye-Tracking Experiment

Public rejection of recycled water hinders the application of recycled water use projects in green communities. An effective information outreach strategy could help to overcome this obstacle. This study used message frames and reference points as control variables to design experimental materials and conduct eye-movement experiments to determine the effect of different information promotion strategies. The results of the study show that: (1) compared with the loss frame, the gain-framed messages are more effective; (2) self-referencing messages are more suitable for recycled water use promotion than other-referencing messages; (3) message frame (gain vs. loss) and reference point (self vs. others) have an interactive effect on the public’s information cognitive behavior; (4) the average duration of fixations for advertising message plays an intermediary role in the path of message frame and reference point jointly influencing the public acceptance. This study provides managerial implications for determining information dissemination strategies for applying recycled water-use projects in green communities.