Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

MRTK3 Gaze input doesn't fallback to head gaze if eye tracking is disabled or not calibrated #11582

Closed
AMollis opened this issue May 27, 2023 · 1 comment

Comments

@AMollis
Copy link
Member

AMollis commented May 27, 2023

This issue has been migrated a new MRTK repository, and the status of this issue will now be tracked at the following location:


Overview

MRTK3 Gaze input doesn't fallback to head gaze if eye tracking is not calibrated or eyes aren't being tracked

Repro

  1. Build EyeGazeExample scene with Eye Tracking permissions enable.
  2. Make sure you clear eye tracking calibration (you'll likely need to reset the device)
  3. Start app, and verify EyeGazeExample scene launches
  4. Move head around
  5. Box colors don't toggle to "red"

Expected

Box colors to toggle to "red" when head gazing (i.e. no eye gaze)

Details

The MRTK Gaze action mapping are currently using fallback composites. This mostly works, if the "eye controller" is not available, the system fallbacks back to head pose. However, there is a problem when "eye controller" is available but not tracking, the "eye controller" binding is still used, and the system doesn't fallback to head pose. The most common case of this happening is when HL2's eye controllers haven't been calibrated for the current user.
image

I've tried removing the fallback composite, but then only head pose is used, and eye controller is ignored.
image

I also tried using "isTracked" as a modifier. But this is not working either, no pose ends up being used.
Image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants