Head-Worn Augmented Reality for Real-Time Navigation Assistance and Event Forecasting in Maritime Operations

Abstract

Human-robot interaction (HRI) in maritime operations is critical for safe and effective collaboration between human operators and autonomous or semi-autonomous vessel systems. In high-risk marine environments, head-worn Augmented Reality (AR) can enhance human-in-the-loop capabilities by delivering real-time navigational data, proactive hazard forecasts, and intuitive interaction frameworks. This paper presents an innovative head-worn AR navigation and event-forecasting system for maritime applications, emphasizing situational awareness, real-time data visualization, and robust calibration across variable ship infrastructures. By leveraging external forecast data and uncertainty visualizations, our approach provides ship captains with critical information about potential collisions and route deviations while maintaining minimal occlusion. We report on two sea trials that informed our design and led to adjustments in the AR "window" placement method for improved alignment and flexibility. Feedback from these trials highlights the potential of comprehensive, real-time AR visualizations to enhance maritime safety and decision-making in complex operational environments.