Projection Mapping Technology Research Articles

Roman Britain in Colour – Roman Altars from Hadrian's Wall Reimagined

Roman Britain in Colour is the title of an intervention in the Hadrian’s Wall Gallery of the Great North Museum: Hancock. This intervention makes use of projection mapping to interpret a series of seven Roman altars; using colour and animation to enhance the visitor experience in the gallery. This paper explores the decision to use projection mapping technology against the background of increased interest and research into the use of pigmentation on Roman sculpture. It outlines some of the benefits of projection mapping for the understanding of archaeological material in museums and discusses some potential drawbacks of the technique as an interpretative tool.

Continuity: Sharing Space in teamLab’s Digital Ecosystems

In 2021, the Asian Art Museum of San Francisco inaugurated the opening of its new contemporary wing with teamLab: Continuity. The immersive exhibition spanned six galleries and was fully interactive via sensors and digital projection mapping technology; flowers bloom and grow, flying crows burst into colorful chrysanthemums, and butterflies are born or killed at a moment’s touch. The digital objects dynamically interact with one another and with humans, blurring boundaries between art, participant, and technology. This article examines Continuity as a “collective interactive experience” situated within a digital ecosystem. It explores teamLab’s approach to the natural environment and its digital replication, with a focus on the relationship between humans and machines in shared exhibition spaces.

Visitor’s experience evaluation of applied projection mapping technology at cultural heritage and tourism sites: the case of China Tangcheng

Research on digital cultural heritage is concerned with the implementation of projection mapping (PJM) technologies, projection viewing, and interactive programs at cultural heritage sites. As PJM technology has come to play an increasingly important role in attracting visitors to museums, heritage pavilions and heritage sites, the topics of digital cultural heritage and digital cultural tourism have become widely discussed in professional and academic circles. However, questions have begun to emerge over the past decade about the relevance of the content presented using PJM at heritage sites and tourist attractions to the sites’ cultural value, and various researchers have attempted to evaluate the effectiveness of PJM on the visitor experience and generate proposals for improvement. Unfortunately, the usefulness of these attempts has been limited by several methodological shortcomings. Therefore, this study proposes an original system for evaluating visitor’s cultural experiences. By evaluating the effectiveness of PJM on visitor’s cultural experiences, a methodology and a set of guidelines for applying PJM that promotes cultural understanding were proposed, and further to achieve an integrated understanding of visitor’s tendency to recall PJM information. Furthermore, a trial run of the system was conducted by the authors in a study of a digital media campaign in October 2021 and the data derived from this investigation are presented in this article as a reference point for comparable cultural heritage and tourism sites.Graphical

Simple Color Calibration Method by Projection onto Retroreflective Materials.

Retroreflective materials have the property of directional reflection, reflecting light strongly in the direction of the light source, and have been used for road traffic signs. In recent years, retroreflective materials have been used in entertainment and industrial technologies, in combination with projection mapping technology. In general, color calibration is important when projectors are used to control reflected colors. In this study, we investigated a simple color calibration method for retroreflective materials with a 3D shape under the condition that they are observed in the same direction as the light source. Three types of retroreflective materials with different reflective properties were used. First, to measure the reflective properties of each reflective material, the reflective material was fixed to a flat plate and rotated, while the reflected light was measured in the same direction as the light source. It was then confirmed that the reflected light intensity varied smoothly with angular change, and appropriate measurement angles were investigated based on the AIC criterion, aiming to interpolate the reflectance characteristics from a small number of measurement angles. Color calibration was performed based on the reflectance characteristics obtained from the derived measurement angles, and the experiments showed that good color calibration was possible with fewer measurements.

Multifocal Stereoscopic Projection Mapping.

Stereoscopic projection mapping (PM) allows a user to see a three-dimensional (3D) computer-generated (CG) object floating over physical surfaces of arbitrary shapes around us using projected imagery. However, the current stereoscopic PM technology only satisfies binocular cues and is not capable of providing correct focus cues, which causes a vergence-accommodation conflict (VAC). Therefore, we propose a multifocal approach to mitigate VAC in stereoscopic PM. Our primary technical contribution is to attach electrically focus-tunable lenses (ETLs) to active shutter glasses to control both vergence and accommodation. Specifically, we apply fast and periodical focal sweeps to the ETLs, which causes the "virtual image" (as an optical term) of a scene observed through the ETLs to move back and forth during each sweep period. A 3D CG object is projected from a synchronized high-speed projector only when the virtual image of the projected imagery is located at a desired distance. This provides an observer with the correct focus cues required. In this study, we solve three technical issues that are unique to stereoscopic PM: (1) The 3D CG object is displayed on non-planar and even moving surfaces; (2) the physical surfaces need to be shown without the focus modulation; (3) the shutter glasses additionally need to be synchronized with the ETLs and the projector. We also develop a novel compensation technique to deal with the "lens breathing" artifact that varies the retinal size of the virtual image through focal length modulation. Further, using a proof-of-concept prototype, we demonstrate that our technique can present the virtual image of a target 3D CG object at the correct depth. Finally, we validate the advantage provided by our technique by comparing it with conventional stereoscopic PM using a user study on a depth-matching task.

Projection Mapping Technology in Architecture from the Perspective of Optical Illusion Art

Optical Illusion art is one of the artistic trends that emerged as a result of the artists’ interaction with the scientific interpretation of the phenomenon of optical illusion, which scientists have benefited from its thoughts about the way the human eye and brain works to create illusions in their artistic work. The research discusses the emergence of the optical illusion art and the related concepts and its impact on human perception, as this art relies on an optical vision of shapes, lines, colors and spaces that gives illusion of movement, depth and perspective. The research deals with the applications of the philosophy of optical illusion art in architecture in addition to the various architectural surfaces and their subsequent developments up to the projection mapping technology, as it’s considered the actual dynamic development of the optical illusion art and the impact of this technology in creating new levels of illusions for the viewer and clarify the similarities and differences between them, Especially the projection mapping technology considerations; how it is planned, and the various aesthetics that it adds to architecture visually only as a digital technology that is displayed by projectors, so it takes the viewer to another imaginary world inside the real world. It is considered one of the design solutions to achieve the visual pleasure for the viewer and enhance his belonging to the place.

공연예술에서 사용되는 프로젝션 맵핑 유형

The projection mapping technology is currently being used in many different fields involving any form of visual display given its diverse and adaptable aspects of use on various ‘screens’, i.e., the walls of buildings, objects, and spaces, to name a few. It is especially recognized in the field of performing arts as a method of artistic expression that goes far beyond what traditional stage settings can accomplish. While technical studies of projection mapping are actively underway, it is evident that there is a lack of theories on how to produce stage images using this technology. This study focuses on the general contents of projection mapping and the visually recognized mapping objects used in stage performances by dividing the three-dimensional stage space into the front, middle and internal areas, which after a case analysis is conducted, with categorization into five types of projection methods: a) projecting images onto the background of a stage and a Shark-tooth Scrim, b) projecting images onto the performers, c) projecting images onto the background of the stage and objects, d) projecting images onto the background of the stage and the performers, and e) projecting images onto the background alone. The categories and examples discussed in this study are to be considered as guidance for proper stage production and for those involved in the design of the appropriate content and characteristics of the performances being given. It is expected, considering all of the aspects discussed in this research, that projection mapping will have a powerful influence on and will inspire the development of performing arts overall.

A study on the solid image projection mapping system in the curved display of the face shape for the performance art

Background/Objectives: Aims to study the projection mapping technology which will project the multi-phase solid image in the curved display real time in the performance.Methods/Statistical analysis: Analyze the shape of the object to be mapped for the project and based on the analyzed characteristics, the structure of the installation of the applicable project to the actual object and the projection mapping production tool shall be developed and be applied to the elastic shape.Findings: According to the analysis result of the curved display, one projector did not suit the image and the distortion of the image occurred. According, it was divided into the four sections and projection mapping was made to minimize the problems, and the projection production tool which applied the geometric matching technology, edge blending technology, UDP telecommunication method etc based on the grid for the image matching using the Max/Msp was developed and the actual face shaped curved display was applied.Improvements/Applications: In order to conduct projection map precisely to the actuator moving real time, Z-depth should be considered and the advanced technology which matches the three dimensional mapping image should be applied.

Development of Teaching Material for Robot Mechanisms Applying Projection Mapping Technology

Teaching materials that can interactively display the vectors of forces and velocities as well as the trajectories and graphs of remarkable points, which are invisible in actual mechanical movements, should be capable of effectively supporting the learning of complex robot mechanics. In this study, we aim to acquire knowledge about the design principles for building teaching materials for robot mechanics, applying projection mapping technology (PM). We have first studied the components required in teaching material systems on the following candidate mechanisms: transmission mechanism with spur gears and quadric crank chain as two basic mechanisms and serial two-link mechanism as a representative subject of robot mechanisms. We have constructed systems and conducted experiments to evaluate their performance. In this study, we propose a fundamental method for designing teaching materials on mechanisms applying PM, establish the effectiveness of the proposed method, and indicate problems with the current systems.

Construction of Immersive Exhibition with Active and Passive Audiovisual Continuity Using Projection Mapping Technology

Construction of Immersive Exhibition with Active and Passive Audiovisual Continuity Using Projection Mapping Technology

Perception of gold materials by projecting a solid color on black materials

AbstractGold gives a unique luxurious impression and therefore golden objects are often desired. Since gold is an expensive metal, due to its rarity, it is not feasible to produce objects made of gold at reasonable prices. In this study, we have developed a simple representation method that makes real objects appear to be made of gold using projection mapping technology. In recent years, this technology has been extensively explored, mainly in the field of entertainment. Most of these studies were focused on technologies where a target image was superimposed onto an object. Our method, unlike the conventional approach, does not project a target gold image but simply projects a solid color onto an object, thereby giving the perception that the object is made of gold. We have conducted two psychophysical experiments to substantiate our representation method, using stimuli having the same color. Our results indicate that objects were more easily perceived as golden objects when a solid color was projected onto black objects rather than white objects. Furthermore, a few samples were perceived as metals, even though they were actually paper or fabric. These results suggest that when superimposing a solid color onto an object, a change in material type is perceived along with the change of its color. Moreover, we analyzed the relationship between psychophysical evaluations on the perception of projected gold objects and the physical properties of the materials. The results show that the average and the standard deviation of reflectance generated by black objects can be considered factors that affect the perception of a gold‐like color. © 2016 Wiley Periodicals, Inc. Col Res Appl, 42, 522–530, 2017

Developing a Mixed Reality Assistance System Based on Projection Mapping Technology for Manual Operations at Assembly Workstations

Abstract Manual tasks play an important role in social sustainable manufacturing enterprises. Commonly, manual operations are used for low volume productions, but are not limited to. Operational models in manufacturing systems based on “x-to-order” paradigms (e.g. assembly-to-order) may require manual operations to speed-up the ramp-up time of new product configuration assemblies. The implications of manual operations in any production line may imply that any manufacturing or assembly process become more susceptible to human errors and therefore translate into delays, defects and/or poor product quality. In this scenario, virtual and augmented realities can offer significant advantages to support the human operator in manual operations. This research work presents the development of a mixed (virtual and augmented) reality assistance system that permits real-time support in manual operations. A review of mixed reality techniques and technologies was conducted, where it was determined to use a projection mapping solution for the proposed assistance system. According to the specific requirements of the demonstration environment, hardware and software components were chosen. The developed mixed reality assistance system was able to guide any user without any prior knowledge through the successful completion of the specific assembly task.

The study of method of 3D installation art contents through new technology - with the case of 3D projection mapping technology expressing reality & virtual reality -

The study of method of 3D installation art contents through new technology - with the case of 3D projection mapping technology expressing reality & virtual reality -