Invited Session IV: Extended reality--applications in vision science and beyond: Augmented reality systems for people with low vision.

Low vision is a visual impairment that cannot be corrected with eyeglasses or contact lenses. Low vision people have functional vision and prefer using that vision instead of relying on audition and touch. Existing approaches to low vision accessibility enhance people's vision using simple "signal-to-signal" techniques that do not take into account the user's context. There is thus a major gap between low vision people's needs and existing low vision technologies. My doctorial research aims to address this gap by augmenting low vision people's visual experience with direct and optimal visual feedback based on the user's context. I will design and study novel methods for visual augmentation , which involves visual feedback beyond simple enhancements. My research considers two dimensions: visual condition and task. By understanding the visual perception of people with different visual abilities and exploring their needs in different visual tasks, I will design applications with visual feedback that is optimal for specific context to maximize people's access to information. My research will yield design insights and novel applications for people with all visual abilities.

Augmented reality (AR) systems make it possible to present visual stimuli that intermix and interact with people's view of the natural world. But building an AR system that merges stimuli with our natural visual experience is hard. AR systems often suffer from technical and visual limitations, such as small eyeboxes, limited brightness, and narrow visual field coverage. An integral part of AR system development, therefore, is perceptual research that improves our understanding of when and why these limitations matter. I will describe a suite of perceptual studies designed to provide guidance for engineers on the visibility and appearance of wearable optical see-through AR displays. Our results highlight the idiosyncrasies of how our visual system integrates information from the two eyes, the multifaceted nature of perceptual phenomena in AR, and the trade-offs that are currently necessary to create an AR system that is both wearable and compelling.

While our community has many active projects involving blind people, low vision is rarely addressed. People with low vision have functional vision, but their visual impairment adversely affects their daily life and it cannot be corrected with glasses or contact lenses. Over the last few years, we have been conducting research with this understudied demographic: understanding low vision people's needs and designing applications to address the challenges they face. In this article, we discuss our ongoing research in this area, focusing on designing augmented reality applications for low vision users. We begin this article by describing low vision and motivating our focus on augmented reality applications on smartglasses for low vision people. We then provide overviews of three research projects that exemplify our research agenda: a study where we observed low vision people conducting a navigation and shopping task, a study where we examined low vision people's perception of virtual text and shapes on smartglasses, and the design of a smartglasses application that facilitates a visual search task.

Avoiding obstacles while navigating is a challenge for people with low vision, who have impaired yet functional vision, which impacts their mobility, safety, and independence. This study investigates the impact of using Augmented Reality (AR) to enhance the visibility of obstacles for people with low vision. Twenty-five participants (14 with low vision and 11 typically sighted) wore smart glasses and completed a real-world obstacle course under two conditions: with obstacles enhanced using 3D AR markings and without any enhancement (i.e., passthrough only - control condition). Our results reveal that AR enhancements significantly decreased walking time, with the low vision group demonstrating a notable reduction in time. Additionally, the path length was significantly shorter with AR enhancements. The decrease in time and path length did not lead to more collisions, suggesting improved obstacle avoidance. Participants also reported a positive user experience with the AR system, highlighting its potential to enhance mobility for low vision users. These results suggest that AR technology can play a critical role in supporting the independence and confidence of low vision individuals in mobility tasks within complex environments. We discuss design guidelines for future AR systems to assist low vision people.

Reading is a challenging task for low vision people. While conventional low vision aids (e.g., magnification) offer certain support, they cannot fully address the difficulties faced by low vision users, such as locating the next line and distinguishing similar words. To fill this gap, we present GazePrompt, a gaze-aware reading aid that provides timely and targeted visual and audio augmentations based on users’ gaze behaviors. GazePrompt includes two key features: (1) a Line-Switching support that highlights the line a reader intends to read; and (2) a Difficult-Word support that magnifies or reads aloud a word that the reader hesitates with. Through a study with 13 low vision participants who performed well-controlled reading-aloud tasks with and without GazePrompt, we found that GazePrompt significantly reduced participants’ line switching time, reduced word recognition errors, and improved their subjective reading experiences. A follow-up silent-reading study showed that GazePrompt can enhance users’ concentration and perceived comprehension of the reading contents. We further derive design considerations for future gaze-based low vision aids.

Developing innovative and pervasive smart technologies that provide medical support and improve the welfare of the elderly has become increasingly important as populations age. Elderly people frequently experience incidents of discomfort in their daily lives, including the deterioration of cognitive and memory abilities. To provide auxiliary functions and ensure the safety of the elderly in daily living situations, we propose a projection-based augmented reality (PAR) system equipped with a deep-learning module. In this study, we propose three-dimensional space reconstruction of a pervasive PAR space for the elderly. In addition, we propose the application of a deep-learning module to lay the foundation for contextual awareness. Performance experiments were conducted for grafting the deep-learning framework (pose estimation, face recognition, and object detection) onto the PAR technology through the proposed hardware for verification of execution possibility, real-time execution, and applicability. The precision of the face pose is particularly high by pose estimation; it is used to determine an abnormal user state. For face recognition results of whole class, the average detection rate (DR) was 74.84% and the precision was 78.72%. However, for face occlusions, the average DR was 46.83%. It was confirmed that the face recognition can be performed properly if the face occlusion situation is not frequent. By object detection experiment results, the DR increased as the distance from the system decreased for a small object. For a large object, the miss rate increased when the distance between the object and the system decreased. Scenarios for supporting the elderly, who experience degradation in movement and cognitive functions, were designed and realized, constructed using the proposed platform. In addition, several user interfaces (UI) were implemented according to the scenarios regardless of distance between users and the proposed system. In this study, we developed a bidirectional PAR system that provides the relevant information by understanding the user environment and action intentions instead of a unidirectional PAR system for simple information provision. We present a discussion of the possibility of care systems for the elderly through the fusion of PAR and deep-learning frameworks.

To compare the efficacy of contact lens use with low vision aids (LVA) with the efficacy of spectacle use with low vision aids. Thirty-six pediatric patients with low vision were enrolled in this study between January 2015 and March 2017. The patients were examined for best-corrected visual acuity (BCVA) with spectacles, spectacles with LVA, contact lenses and contact lenses with LVA. Toleration of the patients with contact lenses and LVA were recorded at the final follow-up exam. The mean BCVA with spectacles was detected as 1.11 ± 0.25 log MAR and the mean BCVA improved to 0.35 ± 0.13 log MAR with the use of spectacles and LVA, which was statistically significant. The mean BCVA with contact lens, which was 0.99 ± 0.22 log MAR, improved to 0.40 ± 0.21 log MAR with contact lens and LVA, which was also significant. There was a statistically significant improvement in BCVA of the patients with contact lenses only when compared to spectacles only. The mean BCVA significantly improved in patients using LVA with contact lenses when compared to LVA with spectacles. Tolerations of the patients with contact lenses and LVA were found to be well at 29 of 36 (80.55%) at final follow-up (26.11 ± 6.85 months). Contact lens use in pediatric patients with low vision especially with LVA offers better visual acuity, a decrease in nystagmus amplitude, wider field of view and comfort.

People with low vision have a visual impairment that affects their ability to perform daily activities. Unlike blind people, low vision people have functional vision and can potentially benefit from smart glasses that provide dynamic, always-available visual information. We sought to determine what low vision people could see on mainstream commercial augmented reality (AR) glasses, despite their visual limitations and the device's constraints. We conducted a study with 20 low vision participants and 18 sighted controls, asking them to identify virtual shapes and text in different sizes, colors, and thicknesses. We also evaluated their ability to see the virtual elements while walking. We found that low vision participants were able to identify basic shapes and read short phrases on the glasses while sitting and walking. Identifying virtual elements had a similar effect on low vision and sighted people's walking speed, slowing it down slightly. Our study yielded preliminary evidence that mainstream AR glasses can be powerful accessibility tools. We derive guidelines for presenting visual output for low vision people and discuss opportunities for accessibility applications on this platform.

This year, Optometry and Vision Science is celebrating its centennial anniversary. It is an honor to usher in the 100th volume, and over this next year, we are looking forward to celebrating the history of optometry and vision science and the individuals who have helped shape vision research and clinical practice over these past 100 years. For those interested in the history of optometry and vision research and for those who are working to shape the next 100 years, stay tuned to the editorials. I hope to make this year's collection something that will be different, informative, and maybe even a little provocative. MYOPIA: MECHANISMS, INTERVENTIONAL STRATEGIES, AND CLINICAL EVIDENCE It is fitting that we begin the new year and our first issue of this centennial with a feature issue on the topic of myopia, a frequent topic of publications in the journal and one central to our professional focus on vision function. Myopia is a leading cause of functional vision loss that is growing worldwide. Projections are that, by 2050, there will be 5 billion myopes worldwide and 1 billion high myopes1—individuals also at greater risk for glaucoma, retinal detachments and other causes of ocular disease and permanent vision loss.2 In the United States, in the 1970s, myopia prevalence was 25%, and it is now estimated to be 42%.3 This incidence is nearly half that of many Asian and Southeast Asian countries.4 Although these numbers are staggering, it has taken a generation to raise awareness and build consensus around the need to address this condition. Nevertheless, there is now a growing interest from the National Institutes of Health and other public health agencies around the world to recognize and address the public health consequences of the growing myopia pandemic. Now that effective clinical interventions for myopia are available, there is growing interest and activity at every level of translational research to better understand underlying risk factors for myopia, the fundamental mechanisms that lead to this condition, its prognosis, possible clinical and behavioral interventions, and the need for greater understanding of the growing public health implications. The journal received a record number of submissions and, from those submissions on these topics and a distinguished guest editorial team, curated an excellent collection of the final accepted articles.Mark Bullimore, MCOptom, PhD, FAAO Editor in Chief Emeritus, Optometry and Vision Science Adjunct Professor, University of Houston College of Optometry Professor Bullimore is an internationally renowned scientist, speaker, and educator based in Boulder, Colorado. He received his optometry degree and PhD in vision science from Aston University in Birmingham, England. He spent most of his career at the Ohio State University and the University of California at Berkeley and is now adjunct professor at the University of Houston. He is the former editor of Optometry and Vision Science. His expertise in myopia, contact lenses, low vision, presbyopia, and refractive surgery means that he is consultant for a number of ophthalmic, surgical, and pharmaceutical companies. This work has resulted in approval of, among others, Paragon CRT, Alcon's iLux, and CooperVision's MiSight lens. He has co-authored more than 100 peer-reviewed scientific articles including several modern classics in the field of myopia control.Alexandra Benavente-Perez, PhD, FAAO Associate Clinical Professor, State University of New York, College of Optometry Alexandra Benavente is an associate clinical professor at the SUNY College of Optometry. She received her degree in optometry and optics from the College of Science and Medicine in Valladolid, Spain; MS in investigative ophthalmology and vision science from the University of Manchester, United Kingdom; and PhD in vision science from Aston University, Birmingham, United Kingdom. She is the principal investigator of her research laboratory, focused on identifying the mechanisms that lead to myopia and associated blinding consequences. She has been a part of the clinical research effort at the college through the Clinical Vision Research Center since its creation in 2013, where she has been a principal investigator in a multicenter research study and subinvestigator in more than 20 clinical studies. Sandra has served as chair of the Association for Research in Vision and Ophthalmology Annual Meeting Program Committee (Anatomy section) and is an appointed member of the Scientific Committees of the American Academy of Optometry and the International Myopia Conference. She has received the Josh Wallman Memorial Award/Zeiss Young Scientist Award in Myopia Research at the International Myopia Conference and the American Academy of Optometry Professional Career Development Award.David Berntsen, OD, PhD, FAAO Associate Professor, University of Houston College of Optometry David A. Berntsen is the Golden-Golden professor of optometry at the University of Houston College of Optometry where he teaches in the graduate and professional programs. He is the chair of the Department of Clinical Sciences and conducts research on myopia, contact lenses, visual performance, and aberrations of the eye. He completed his doctor of optometry degree at the University of Houston and a Cornea and Contact Lens Advanced Practice Fellowship, MS, and PhD at The Ohio State University. He conducted the Study of Theories about Myopia Progression (STAMP), a 2-year clinical trial evaluating theories of juvenile-onset myopia progression and is the principal investigator of the University of Houston clinical site for the Bifocal Lenses In Nearsighted Kids (BLINK) Study and the BLINK2 Study, a multicenter study sponsored by the National Eye Institute evaluating contact lenses for myopia control. Dr. Berntsen serves on the American Academy of Optometry's Scientific Program Committee and is a diplomate in the Section on Cornea, Contact Lenses, and Refractive Technologies.Timothy Gawne, PhD Professor, University of Alabama at Birmingham Timothy Gawne, PhD, started out as an electrical engineer with a degree from Massachusetts Institute of Technology, and for a time, he worked at Digital Equipment Corporation. He then got a PhD in physiology from the Uniformed Services University of the Health Science and moved into visual neuroscience. He is currently a professor in the School of Optometry at the University of Alabama at Birmingham. His major research interest is determining how the neural retina can use visual cues to evaluate defocus and guide ocular elongation to achieve and maintain good focus (emmetropization). He uses as an animal model the tree shrew, small diurnal mammals very closely related to primates. He is also working to develop more effective methods for combating myopia (nearsightedness).Kee Chea Su, BSc (Hons) Optom, MA, PhD Professor, The Hong Kong Polytechnic University Prof. Kee is a professor teaching optometry subjects related to clinical and ophthalmic dispensing at the School of Optometry, The Hong Kong Polytechnic University. He received his bachelor's degree in optometry from the Hong Kong Polytechnic University. He later obtained his master's and PhD degrees from the City College of New York and University of Houston, respectively. Before returning to Hong Kong, Prof. Kee was an assistant professor in physiological optics at the New England College of Optometry in Boston, Massachusetts. Prof. Kee is appointed as the interim head of the Hong Kong Polytechnic University's School of Optometry and the interim director of Research Centre for SHARP Vision in 2022. Prof. Kee's constant research interest is how visual optics regulate eye growth. Through active collaborations with vision scientists and engineers around the world, Prof. Kee and his team have devised ocular diagnostic tools and animal models to study the role of visual experience on refractive development. Knowledge gained from the mixture of basic and translational research has accelerated our knowledge transfer.Lisa Ostrin, OD, PhD, FAAO Associate Professor, University of Houston College of Optometry Dr. Ostrin is an associate professor at the University of Houston College of Optometry. She received a bachelor of arts degree in studio art at the University of Texas at Austin. She then completed the combined OD/PhD program at the University of Houston College of Optometry. After graduate work focused in accommodative physiology, she went to John Hopkins University for post-doctoral research in low vision and retinal prosthetics. From there, she worked as a clinician researcher at the University of California Berkeley School of Optometry with a focus on myopia. She returned to the University of Houston as faculty to continue her work in myopia and circadian rhythms. Her laboratory is interested in how light exposure and other behavioral factors influence eye growth and myopia development. Dr. Ostrin is a Fellow of the American Academy of Optometry, Gold Fellow of Association for Research in Vision and Ophthalmology, and a past recipient of the American Optometric Foundation Ezell Fellowship. In addition to research, Dr. Ostrin teaches gross and ocular anatomy in the optometry program at the University of Houston and recently authored the book Anatomy of the Human Eye: A Coloring Atlas.Scott Read, BAppSc (Optom), PhD, FAAO Associate Professor, Queensland University of Technology Scott Read is a professor in Queensland University of Technology's School of Optometry and Vision Science, with more than 15 years' experience in vision research. The primary focus of his research has been to better understand the ocular and environmental factors underlying human myopia development and progression. His work has used high-resolution imaging and wearable sensor technology to provide novel insights into these research areas. Professor Read was awarded the "Zeiss Young Investigator Award in Myopia Research" for his distinguished contributions to the myopia research field. In his career to date, Professor Read has authored more than 120 research publications and has been awarded more than $2.5 million in research funding from a variety of sources. Scott has been a fellow of the American Academy of Optometry since 2012. He has also been an associate editor and editorial board member for Clinical and Experimental Optometry and is currently an editorial board member and a topical associate editor for Optometry and Vision Science.Kathryn Richdale, OD, PhD Dr. Kathryn Richdale received her BS from the University of Notre Dame and her OD, PhD, and Cornea and Contact Lens Advanced Practice Fellowship from The Ohio State University. She was founding director of the Clinical Vision Research Center and established the Myopia Control Clinic at the State University of New York College of Optometry before joining the University of Houston College of Optometry as a tenured associate professor in 2017. Dr. Richdale served as an attending in the Cornea and Contact Lens Service, directed the Myopia Management Service, and led the interprofessional education at University of Houston College of Optometry. She held industry, private, or government grant funding for more than 20 years and published more than 50 peer-reviewed manuscripts. In 2022, she joined CooperVision as a clinical research fellow. Dr. Richdale is past chair of the American Academy of Optometry Research Committee and board member of its foundation and earned a diplomate in the Cornea, Contact Lenses and Refractive Technologies section in 2021.Jeffrey Walline, OD, PhD Professor, The Ohio State University Jeffrey J. Walline, OD, PhD, is the associate dean for research at The Ohio State University College of Optometry and president-elect of the American Academy of Optometry. He received his doctor of optometry degree from the University of California, Berkeley School of Optometry, and he received his master's and PhD degrees from The Ohio State University College of Optometry. Dr. Walline has led several pediatric contact lens studies, and he is the study chair of the Bifocal Lenses In Nearsighted Kids (BLINK) Study, a National Eye Institute–sponsored randomized clinical trial to investigate the myopia control effects of soft multifocal contact lenses.James Wolffsohn, BSc, MBA, PhD, FAAO Professor, Aston University, Optometry and Vision Science Research Group James S. Wolffsohn, a professor of optometry at Aston University since 2000, formerly deputy executive dean for life sciences, and then associate pro-vice-chancellor, is the head of the School of Optometry and head of the Department of Audiology. Before his appointment to Aston University, Professor Wolffsohn was a clinical research fellow at the University of Melbourne in Australia after an optometry degree at the University of Manchester, training period at Moorfields Eye Hospital, and a PhD at Cardiff University. His main research areas are the development and evaluation of ophthalmic instrumentation, myopia management, contact lenses, intraocular lenses, and the tear film. He is a national teaching fellow, has published more than 295 full peer-reviewed papers, and presented at numerous international conferences. He is the academic chair of the British Contact Lens Association, having previously being president and chair of the BCLA Contact Lens Evidence–based Academic Reports; he is on the executive of Tear Film and Ocular Surface Society (TFOS) and was a harmonizer and subcommittee chair for TFOS Dry Eye Workshop II and TFOS Lifestyle reports; he is the International Myopia Institute's Chief Scientific Officer and was joint chair of their white papers. He holds the BCLA Medal (2021) and American Academy of Optometry's Glenn Fry Award (2022). The topics you will find in this issue include studies that address demographic descriptions and population studies of risk factors. We also include clinical evaluations of biometric findings and behavioral interventions for myopia, clinical trial results on astigmatic myopia, and interesting findings on possible driving mechanisms such as spectral effects of blue light. Here is a brief summary of the articles in our feature issue: The 2020 Prentice Award Lecture [Zadnik] Investigations on refractive errors and ocular biometry [Hashemi] Retinal shape in isometropes and anisometropes [Verkicharla] A clinical study to assess the impact of a behavioral intervention designed to reduce the effect of digital device use on myopia progression [Rosenfeld] Strategies in the management of myopia progression [Grzybowski] Clinical outcomes from a controlled clinical trial for astigmatic myopia management [Tomiyama] A clinical perspective piece on fighting myopia with intermittent near-work breaks [Pucker] The effects of evening blue light effects on lens compensation [Nickla] A study of ethnic disparities in risk factors for myopic children in China [Yang] A surprising report of stable prevalence of myopia among Swedish children [Bro] Findings on choroidal thickness profiles in myopic children [Kobia-Acquah] We hope you enjoy this feature issue and share our excitement about the coming year and the scientific advances that it may bring. It is a great time to be in Optometry and Vision Science! Michael D. Twa, OD, PhD, FAAOEditor in ChiefOptometry and Vision ScienceUniversity of Houston College of OptometryHouston TX

Virtual Reality technology helps in creating virtual environments for evaluation of visual performance of low vision individuals with holistic experience. The purpose of this study was to develop a virtual reality (VR) platform for the objective assessment of functional vision in patients with low vision in two categories, central and peripheral vision loss . Focus group discussions (FGD) were organized to understand the difficulties faced on a day to day basis by patients with low vision. Based on the results of the focus group discussions, a virtual bank scenario incorporating specific visual tasks was developed. A pilot study was conducted which involved people with normal vision; low vision Patients secondary to central field loss (CFL) and peripheral field loss (PFL). Each subject completed all the tasks in the objective assessment; the data obtained from the assessment were further analyzed to understand the pattern. Comparing the three groups, there was a significant difference in distance (central field loss was lowest) and near visual angle, and three visual search tasks (peripheral field loss was lowest). In assessing the time taken, peripheral field loss group was again found to take the most time to complete tasks. Based on a newly developed virtual reality platform, assessment of functional vision of specially abled persons could be tested and was inferior to that of normal sighted persons. in a close to realistic environment. Multiple visual tasks were performed in the virtual environment and the visual performance was compared among all three groups of participants. Participants were matched for age and gender. Irrespective of the nature of tasks, visual performance of the normal group seemed significantly better than people with CFL and PFL.

Sensory-perceptual difficulties are a common characteristic in Autism Spectrum Disorders (ASD). Studies in children with ASD describe an array of challenging behaviors regarding sensory simulation. Parents, special educators, and therapists are often witnessing these behaviors throughout the day. This study aimed to use an Augmented Reality (AR) system for the simulation of the sensory overload that children with ASD experience. A total of seventy (N=70) parents, special educators, and therapists of children with ASD responded to researchers’ invitation for this study. Researchers held individual sessions with each participant who wore a head-mounted AR device (Magic Leap OneTM). Six visual and two auditory stimuli were individually and consecutively administered via the AR device. Participants experienced autism-like sensory overload under controlled conditions. Their acceptance and experience of the AR device were measured with the use of three online questionnaires (Temple Presence Inventory, TPI; Simulator Sickness Questionnaire, SSQ; Technology Acceptance Model, TAM). An open-ended question was also administered to measure the overall AR experience. In regard to the study’s findings for participants’ experience, the results from the TPI (Cronbach's Alpha = .84) suggested that the AR system offered a convincing blended environment. Also, low scores in SSQ indicated that the use of the AR system was comfortable. The results from the TAM showed in their majority high internal consistency (> .70) and high mean scores. This indicated that the participants accepted the AR system. In the open-ended question, participants reported overall satisfaction from their experience with the AR system. The study’s findings suggested that the AR device enabled participants to experience a sensory overload similar to the one child with ASD report. Participants’ experience was deemed to be convincing, comfortable, and user-friendly. The results of this study are encouraging and highlight the potential of AR in autism research. Future studies are needed to incorporate richer and more interactive AR simulations for authentic real-life experiences.

Cooking is a vital yet challenging activity for blind and low vision (BLV) people, which involves many visual tasks that can be difficult and dangerous. BLV training services, such as vision rehabilitation, can effectively improve BLV people’s independence and quality of life in daily tasks, such as cooking. However, there is a lack of understanding on the practices employed by the training professionals and the barriers faced by BLV people in such training. To fill the gap, we interviewed six professionals to explore their training strategies and technology recommendations for BLV clients in cooking activities. Our findings revealed the fundamental principles, practices, and barriers in current BLV training services, identifying the gaps between training and reality.

Dementia alters standing postural adaptation during a visual search task in older adult men

Visual search is a major challenge for low vision people. Conventional vision enhancements like magnification help low vision people see more details, but cannot indicate the location of a target in a visual search task. In this paper, we explore visual cues---a new approach to facilitate visual search tasks for low vision people. We focus on product search and present CueSee, an augmented reality application on a head-mounted display (HMD) that facilitates product search by recognizing the product automatically and using visual cues to direct the user's attention to the product. We designed five visual cues that users can combine to suit their visual condition. We evaluated the visual cues with 12 low vision participants and found that participants preferred using our cues to conventional enhancements for product search. We also found that CueSee outperformed participants' best-corrected vision in both time and accuracy.

Current augmented reality (AR) systems are not designed to be used in our daily lives. Head-mounted see-through displays are too cumbersome and look too unusual for everyday life. The limited scalability of position-tracking devices limits the use of AR to very restricted environments. This paper proposes a different way to realize AR that can be used in an open environment by introducing the concept of ID awareness and a hand-held video see-through display. Unlike other AR systems that use head-mounted or head-up displays, our approach employs the combination of a palmtop-sized display and a small video camera. A user sees the real world through the display device, with added computer-augmented information. We call this configuration the magnifying glass approach. It has several advantages over traditional head-up or head-mounted configurations. The main advantage is that the user is not required to wear any cumbersome headgear. The user can easily move the display device around like a magnifying glass and compare real and augmented images. The video camera also obtains information related to real-world situations. The system recognizes real-world objects using the video images by reading identification (ID) tags. Based on the recognized ID tag, the system retrieves and displays information about the real-world object to the user. The prototype hand-held device based on our proposed concept is called NaviCam. We describe several potential applications. Our experiments with NaviCam show the great potential of our video see-through palmtop display. It was significantly faster than a head-up configuration, and its subjective score from testers was also higher.