Enhanced ROV Performance Using AR/VR HUDs

Abstract

Abstract Custom Augmented Reality (AR), Mixed Reality (MR), and Virtual Reality (VR) Human Machine Interfaces (HMIs) or Heads Up Displays (HUDs) are proving to offer major benefits for Remotely Operated Vehicle (ROV) operators in enhancing situational awareness, decreasing task time, and at a corporate level reducing the total cost of an ROV operation. In this paper Casey Sapp will examine the state of the technology, pertinent case studies, and operator outcomes from recent tests. The AR/VR interfaces described in this paper leverages the recent development in affordable Commercial-Off-the-Shelf (COTS) Head Mounted Display (HMD) technology to visualize operational ROV data with real end users and commercial clients. Technology demonstrations and user data acquisition has occurred since 2018 starting with Monterey Bay Aquarium Research Institute (MBARI) and currently with Navy Explosive Ordnance Disposal (EOD) PMS 408. The findings in this paper offer scalable system architectures and tools which are possible to implement today by ROV services companies Oil & Gas industry. The conclusions show that AR/VR HUDs have a material impact on operator satisfaction, decreasing complexity of a project, and Return on Investment (ROI) by reducing the total cost of an operation. Blue Ring has ongoing studies which are consistent with studies performed in the past with partners including Monterey Bay Aquarium Research Institute (MBARI) and are establishing improved performance and cost reductions. More statistical results are forthcoming. Through five years of prototyping and experimentation with end users both in live environments and through simulation Casey will provide real case studies and observations where AR/VR HUDs have made a difference with real organizations who use ROVs. The concepts and results can be easily transferred to other subsea industries including Oil & Gas.