Immersive Media Research Articles

Natural Locomotion Interfaces – With a Little Bit of Magic!

The mission of the Immersive Media Group (IMG) is to develop virtual locomotion user interfaces which allow humans to experience arbitrary 3D environments by means of the natural walking metaphor. Traveling through immersive virtual environments (IVEs) by means of real walking is an important activity to increase naturalness of virtual reality (VR)-based interaction. However, the size of the virtual world often differs from the size of the tracked lab space so that a straightforward implementation of omni-directional and unlimited walking is not possible. Redirected walking is one concept to address this issue by inconspicuously guiding the user on a physical path that may differ from the path the user perceives in the virtual world. For example, intentionally rotating the virtual camera to one side causes the user to unknowingly compensate by walking on a circular arc into the opposite direction. In the scope of the LOCUI project, which is funded by the German Research Foundation, we analyze how gains of locomotor speed, turns and curvatures can gradually alter the physical trajectory with respect to the path perceived in the virtual world without the users observing any discrepancy. Thus, users can be guided in order to avoid collisions with physical obstacles (e.g., lab walls) or they can be guided to arbitrary locations in the physical space. For example, if the user approaches a virtual object, she can be guided to a real proxy prop that is registered to and aligned with its virtual counterpart. Hence, the user can interact with a virtual object by touching the corresponding real-world proxy prop that provides haptic feedback. Based on the results of psychophysical experiments we plan With such a user interface it becomes possible to intuitively interact with any virtual object by touching registered real-world props.

실감미디어 산업의 경제적 파급효과 분석

디지털 정보기술 및 네트워크 기술의 발전에 따라 방송을 중심으로 실감미디어를 활용한 실감형 서비스들이 출현하고 시장의 수요가 증가함에 따라 실감미디어 기술에 대한 연구가 활발히 진행되고 있다. 실감콘텐츠의 제작 전송 기술 및 이를 서비스하는 산업을 통칭하여 실감미디어 산업이라고 한다. 실감미디어 산업은 교육, 건강, 여행, 공공 서비스 등 타 산업분야와 융복합을 통해 사업영역 확대가 용이하고 시장성이 높아 차세대 전략 산업으로 주목받고 있다. 실감미디어 산업의 주도권을 확보하기 위한 미국, 일본, 유럽 등 선진국의 노력이 가시화됨에 따라 우리 정부도 실감미디어 산업을 육성하기 위한 계획을 마련 중에 있다. 이처럼 실감미디어 산업은 미래 방송/통신산업과 콘텐츠산업을 아우르는 최첨단 융복합산업이며 차세대 국가성장동력의 핵심산업군으로 떠오르고 있다. 이에 따라 본 연구에서는 실감미디어 산업의 경제적 파급효과를 계량적인 측면에서 분석하고 산업구조적 특성을 규명하기 위해 산업연관표를 이용하여 실감미디어 연관산업과 타 연계산업과의 관계를 분석하고자 하였다. 분석 결과 실감미디어 산업의 생산유발효과 및 부가가치유발효과, 고용유발효과는 각각 6,109억 원, 4,687억 원, 3,258명 등으로 나타났다. The research on the immersive media technology is actively being done with the emergence of immersive services using immersive media, especially in the broadcasting industry and with the increased market demand for it. The industry which produces, transmits, processes and services the immersive contents is commonly called Immersive Media Industry. Immersive Media Industry has recently received attention as next-generation strategic industry with its high marketability and its high possibility of market expansion through convergence with other industry such as education, health, advertisement, travel and public service industry. As other advanccd country such as the U.S., Japan and Europe buckle down to take the innitiative in the immersive media industry, Korea government also begins to make plan to promote the immersive media industry. As above, immersive media industry is a cutting-edge convergence industry which embraces broadcasting, telecommunication and contents industry and it is rising as core growth engine industry. This article analyses the economic effects of immersive media industry through quantatitive method and evaluates the relations between the immersive media industry and the other related industries. As a result, the effect on production inducement of immersive media industry is 610.9 billion Korean Won; the effect on value-added inducement is 468.7 billion Korean Won; and it is measured that 3,258 job will be created by the immersive media industry.

Children’s Media Culture in a Digital Age

Digital mediation is central to how children and youth grow up in the global North and in much of the global South today. In taking account of this situation, of late researchers have tended to draw on a sociology of the child in conjunction with an examination of how digitization is changing the experience of childhood itself. This article also begins by tracking key social, economic and cultural changes in young people’s lives. We then link these changes to the immersive media life many children around the world are living today, and note the worries this raises among parents, educators and others. To conclude, we identify the paradox of participation that is shaping children’s digital culture and forcing researchers and others to reconsider the relationships between consumerism and civic life.

Corpus Corvus

Corpus Corvus is a mixed reality performance artwork that utilizes stereoscopic projection, motion capture animation, an integrated physical/media choreographic vocabulary, and electroacoustic composition to explore the Pacific Northwest Native American myth of the raven as god and thief who steals the sun and creates the universe. Formally, the work explores the relationship between movement of a physical body and stereoscopic animation in a physical/digital three-dimensional image field. The animation is generated from motion capture data and kinesthetic media composition processes based on physical choreography. Through precise temporal alignment and stereoscopic theatrical effect, the projected animation is perceived to surround the performing body in physical space. The art/research process contextualizing Corpus Corvus is a practice-based exploration and discovery of an emerging poetics that extends the human sensory system into immersive media perceptual hyperspaces. This paper illuminates the process of research, manifestation, and discovery that informs the artwork and its poetics.

The Role of Immersive Media in Online Education

An increasing number of educators are integrating immersive media into core course offerings. Virtual worlds, serious games, simulations, and augmented reality are enabling students and instructors to connect with content and with one another in novel ways. As a result, many are investigating the new affordances these media provide and the impact each is having on important pedagogical constructs such as presence, immediacy, and immersion. New models for designing, delivering, and facilitating instruction are emerging, many with a particular eye toward supporting adult and continuing learners in the 21st century.

Synaestheory: Fleshing Out a Coalition of Senses

Synaestheory: Fleshing Out a Coalition of Senses

Free-space human interface for interactive music, full-body musical instrument, and immersive media controller

Method and apparatus entraining interactive media players into a sustained experience of 'Kinesthetic Spatial Sync' defined as a perceived simultaneity and spatial superposition between a non-tactile, full body input control process and immersive multisensory feedback. Asynchronous player input actions and clock-synchronous media feedback events exhibit a seamless synesthesia or multisensory events fused into an integral event perception, this being between musical sound (hearing), visual responses (sight), and body kinesthetic (radial extension, angular position, height, speed, timing and precision). This non-tactile interface process and multisensory feedback “look and feel” is embodied as an optimal ergonomic human interface for interactive music and as a six-degrees-of-freedom full-body-interactive immersive media controller 1. The invention provides for a wide scope of fully reconfigurable transfer functions between kinesthetic input features and media responses ( Creative Zone Behaviors) managed by means of MIDI protocol and/or display interface commands.

Virtual reality: A state-of-the-art survey

This paper presents a survey on virtual reality systems and provides an in-depth understanding toward the notion of immersion, according to the semantic meanings of the terms “virtual” and “reality”. The paper analyses the structure and functions of a virtual reality system and takes the three dimensional display as the immersive medium to identify the key issues for construction of virtual environments. The paper also reviews the development of virtual reality technology and introduces new image processing techniques into the design of virtual reality systems and virtual environments.

Analyzing perceptual attributes of 3d video

The 3D (3 dimensional) video technologies are emerging to provide more immersive media content compared to conventional 2D (2Dimensional) video applications. In this paper we propose a joint source channel coding scheme (JSCC) for colour and depth based 3D video coding using subjective quality of 3D video. We considered different source and channel coding rates to find the optimum JSCC scheme under a given channel bit rate for a WiMAX based communication channel. More often 3D video quality is measured using rigorous and time-consuming subjective evaluation test campaigns. Hence this paper further extends the above study to investigate the relationship between perceptual attributes of 3D video and overall 3D quality and the correlation of these perceptual attributes with several objective quality measures for 3D video content. The results show that, Gaussian and linear polynomial mathematical models can be used to approximate the relationship between depth perception and image quality with overall 3D quality. Also results implies that, VQM and SSIM quality measures of individual left and right views can be effectively used in predicting the image quality and depth perception of 3D video respectively.

I Wanted to See All the News from Today

I wanted to See all the news from Today http://allnews.greyisgood.eu/ Martin John Callanan Marshall McLuhan once quipped that people don’t read newspapers so much as submerge into them. The patron saint of digital culture likened this action, a veritable ‘sinking’ into disparate streams of information, as something an individual would approach as casually as they’d slip into a warm bath. Martin John Callanan’s I wanted to See all the news from Today provides a similar immersive media experience by aggregating the front page of hundreds of newspapers from around the world and displaying these images within the screen space of a single web page. Launched in 2007, the piece mines more than 600 papers originating in seven continents, continuously scraping data from these sources every day without pause. These pages are organized to form a massive grid that references the familiar ‘image gallery’ and ‘array of thumbnails’ that are associated with managing digital information assets, but subverts these organizational frameworks towards different ends.

Immersive Interfaces for Engagement and Learning

Immersion is the subjective impression that one is participating in a comprehensive, realistic experience. Interactive media now enable various degrees of digital immersion. The more a virtual immersive experience is based on design strategies that combine actional, symbolic, and sensory factors, the greater the participant's suspension of disbelief that she or he is "inside" a digitally enhanced setting. Studies have shown that immersion in a digital environment can enhance education in at least three ways: by allowing multiple perspectives, situated learning, and transfer. Further studies are needed on the capabilities of immersive media for learning, on the instructional designs best suited to each type of immersive medium, and on the learning strengths and preferences these media develop in users.

Quality analysis for 3D video using 2D video quality models

The 3D (3-dimensional) video technologies are emerging to provide more immersive media content compared to conventional 2D (2-dimensional) video applications. More often 3D video quality is measured using rigorous and time-consuming subjective evaluation test campaigns. This is due to the fact that 3D video quality can be described as a combination of several perceptual attributes such as overall image quality, perceived depth, presence, naturalness and eye strain, etc. Hence this paper investigates the relationship between subjective quality measures and several objective quality measures like PSNR, SSIM, and VQM for 3D video content. The 3D video content captured using both stereo camera pair (two cameras for left and right views) and colour-and-depth special range cameras are considered in this study. The results show that, VQM quality measures of individual left and right views (rendered left and right views for colour-and-depth sequences) can be effectively used in predicting the overall image quality and statistical measures like PSNR and SSIM of left and right views illustrate good correlations with depth perception of 3D video.

3‐D crosstalk and luminance uniformity from angular luminance profiles of multiview autostereoscopic 3‐D displays

Abstract— Autostereoscopic 3‐D display technologies enable a more immersive media experience by adding real depth to the visual content. However, the method used for the creation of a sensation of depth or stereo illusion contains several display design and content‐related issues that need to be carefully considered to maintain sufficient image quality. Conventionally, methods used for 3‐D image‐quality evaluations have been based on subjective testing. Optical measurements, in addition to subjective testing, can be used as an efficient tool for 3‐D display characterization. Objective characterization methods for autostereoscopic displays have been developed. How parameters affecting stereo image quality can be defined and measured, and how their effect on the stereo image quality can be evaluated have been investigated. Developed characterization methods are based on empirically gathered data. In this paper, previously presented methodology for two‐view displays is extended to cover autostereoscopic multiview displays. A distinction between displays where the change in content occurs in clear steps when the user moves in front of the display, and displays where the apparent movement of the objects is more continuous as a function of the head movement is made. Definitions for 3‐D luminance and luminance uniformity, which are equally important, as well as 3‐D crosstalk, which is the dominant factor in the evaluations of the perceived 3‐D image quality, is focused upon.

One River (running . . .): Hybrid Space – Open Composition for an Immersive Environment

The theoretical and practical concepts presented here pivot around the composition and design of an interactive audiovisual installation, presented at the Surrey Arts Centre in 2005: One River (running . . .). This immersive media environment is a new form of participatory documentary that reflects the contemporary Surrey community it is presented in. This open composition takes advantage of a set of braided computational media and narrative processes as a dramatic model and integrates computation as a medium for composition, expanded immersive environment, performance and improvisation. The concept of braided processes provides a model for braided conversations and provides an open frame-work for describing an integrated relationship among various independent elements that comprise the complex media braid within the One River (running . . .) environment and is discussed in detail in this paper.

Wireless Affections: Embodiment and Emotions in New Media/Theory and Art

A central strategy in selling information technology has involved the appropriation of earlier historical notions of the ether: as an immersive environment, communicative medium and electronic presence. Just as telephony was connected to the ‘wireless ether’, virtual reality and cyberspace have been connected to the idea of a virtual, electronic sphere, represented as an informatic space, through which a mode of (digital) being is conducted. However, as this paper will argue, while the data trails generated through ‘dataveillance’ technologies, or the information collected by wearable computers, may indeed situate the individual within a digitally rendered ‘ether’, these technologies are based on the generation of knowledge more than the creation of a space, installing an epistemological, rather than an ontological framework for understanding telepresent agency. With reference to recent works by Canadian artist Catherine Richards, this paper will discuss both research into new ‘reality mining’ and ‘affective computing’ technologies and the discourse of posthumanism, as it elaborates the transformation from autonomous liberal subject to post-human hybrid currently underway, and the developing relationships between humans and embodied, emotionally intelligent machines.

Three-dimensional image processing in the future of immersive media

This survey paper discusses the three-dimensional image processing challenges posed by present and future immersive telecommunications, especially immersive video conferencing and television. We introduce the concepts of presence, immersion, and co-presence and discuss their relation to virtual collaborative environments in the context of communications. Several examples are used to illustrate the current state of the art. We highlight the crucial need of real-time, highly realistic video with adaptive viewpoint for future immersive communications and identify calibration, multiple-view analysis, tracking, and view synthesis as the fundamental image-processing modules addressing such a need. For each topic, we sketch the basic problem and representative solutions from the image processing literature.

View synthesis by trinocular edge matching and transfer

This paper presents a novel automatic method for view synthesis (or image transfer) from a triplet of uncalibrated images based on trinocular edge matching followed by transfer by interpolation, occlusion detection and correction and finally rendering. The edge-based technique proposed here is of general practical relevance because it does not rely upon dense correspondences and is computationally efficient. Applications range from immersive media and teleconferencing, image interpolation for fast rendering and compression.

Plurale Sinnlichkeit. Glaubenswahrnehmung im Zeitalter der virtual reality

The essay explores how the perception of faith is bound up with the alertness of the senses. Modern and postmodern schematisation of sensual perception - the » greedy eye of modernity« with its tendency to put anything that is perceived under one unifying aspect or the postmodern turn to the »immersive media « which deliver data to every single sense independently - must be challenged by a theological analysis of the perichoresis of the senses when they are awakened by the healing touch of Christ. From an analysis of Augustine's reworking of the Origenist doctrine of the »spiritual senses « it becomes clear that faith as sensitivity for the hidden activity of God in the world is centred in the heart as the horizon of perception, which gives orientation to the activity of the senses and must at the same time itself be understood sensually as a heart that is able to hear, see, etc. Taken seriously, this plural sensibility must shed a critical light on every theological and non-theological claim about the representation of human perception in one » sense over the senses «, be it conceived as a sensus historicus, a religious sense for transcendence or the inevitabe human quest for meaning.

A dodecahedral approach to immersive imaging and display

article Free Access Share on A dodecahedral approach to immersive imaging and display Author: David McCutchen Immersive Media Co., Portland, OR Immersive Media Co., Portland, ORView Profile Authors Info & Claims ACM SIGGRAPH Computer GraphicsVolume 31Issue 2May 1997 pp 35–37https://doi.org/10.1145/271283.271299Online:01 May 1997Publication History 3citation208DownloadsMetricsTotal Citations3Total Downloads208Last 12 Months2Last 6 weeks2 Get Citation AlertsNew Citation Alert added!This alert has been successfully added and will be sent to:You will be notified whenever a record that you have chosen has been cited.To manage your alert preferences, click on the button below.Manage my Alerts New Citation Alert!Please log in to your account Save to BinderSave to BinderCreate a New BinderNameCancelCreateExport CitationPublisher SiteeReaderPDF