Head Mounted Augmented Reality (AR)

The GIVA research group employs head-mounted Augmented Reality (AR), as one example of mixed reality (MR) technologies, in empirical research for navigation and wayfinding. By means of Microsoft’s HoloLens 2, holograms can be projected into and melded seamlessly with the real environment. The system can track users’ hands which allows for hands-free use without any additional controller. Real-time localization and mapping permit the system to detect and remember its position in the real world.

Image by Patrick Luchsinger (2023), from his Master's thesis:
LandMarkAR: An application to study virtual route instructions and the design of 3D landmarks for indoor pedestrian navigation with a mixed reality head-mounted display, Department of Geography, University of Zurich
 

HoloLens 2

Display

• Optics: See-through holographic lenses (waveguides)
• Resolution: 2k 3:2 light engines
• Holographic density: >2.5k radiants (light points per radian)
• Eye-based rendering: Display optimization for 3D eye position

Sensors

• Head tracking: 4 visible light camera
• Eye tracking: 2 IR cameras
• Depth: 1-MP time-of-flight (ToF) depth sensor
• IMU: Accelerometer, gyroscope, magnetometer
• Camera: 8-MP stills, 1080p30 video

Audio and speech

• Microphone array: 5 channels
• Speakers: Built-in spatial sound

Human understanding

• Hand tracking: Two-handed fully articulated model, direct manipulation
• Eye tracking: Real-time tracking
• Voice: Command and control on-device; natural language with internet connectivity
• Windows Hello: Enterprise-grade security with iris recognition

Environment understanding

• 6DoF tracking: World-scale positional tracking
• Spatial Mapping: Real-time environment mesh
• Mixed Reality Capture: Mixed hologram and physical environment photos and video

Compute and connectivity

• SoC: Qualcomm Snapdragon 850 Compute Platform
• HPU: Second-generation custom-built holographic processing unit
• Memory: 4-GB LPDDR4x system DRAM
• Storage: 64-GB UFS 2.1
• Wi-Fi: Wi-Fi 5 (802.11ac 2x2)
• Bluetooth: 5
• USB: USB Type-C

Fit

• Single size: Yes
• Fits over glasses: Yes
• Weight: 566g

Software

• Windows Holographic Operating System
• Microsoft Edge
• Dynamics 365 Remote Assist
• Dynamics 365 Guides
• 3D Viewer

Power

• Battery life: 2–3 hours of active use
• Charging: USB-PD for fast charging
• Cooling: Passive (no fans)