Handle input from audio glasses and display glasses

Applicable XR devices

This guidance helps you build experiences for these types of XR devices.

Learn about XR device types →

Learn about XR device types →

Users interact with audio glasses and display glasses in different ways, such as the following:

• Asking a question using their voice.
• Gesturing on the touchpad (for example, tapping or swiping back, forward, up, and down)
• Pressing a button on the side of their device.

Android XR has built-in support for some of these use cases, while others require you to customize or extend the system's default behavior or implement certain APIs.

Regardless of whether a user has audio glasses or display glasses, their voice is their primary way to interact with their device.

This guide covers the following ways of handling input:

• How to handle physical input.
• How to handle audio input using automatic speech recognition.

This guide assumes you're familiar with the following concepts:

• Requesting hardware permissions
• Android activities
• The activity lifecycle
• Activity state changes