Abstract
The work presents a practical Augmented Reality (AR) based surgical navigation system using optical see-through head-mounted display as a standalone solution, without the need of additional tracking hardware. Specifically, we propose a fiducial marker-based instrument tracking, which entirely relies on the built-in hardware of the Microsoft HoloLens 2. The tracking algorithm computes the pose of the tracked object from the real-time image obtained from the on-board front-facing RGB camera. The estimated transformation is then transmitted back to the HoloLens for visualization. Our experimental evaluation shows that the system can achieve 0.81 mm / 1.52 degree in tracking accuracy and sub-millimeter alignment accuracy.