Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

custom accessibility inspector #12

Open
phillco opened this issue Mar 27, 2022 · 1 comment
Open

custom accessibility inspector #12

phillco opened this issue Mar 27, 2022 · 1 comment
Labels

Comments

@phillco
Copy link
Owner

phillco commented Mar 27, 2022

MacOS includes an app called the Accessibility Inspector, which we frequently use during development:

Screen Shot 2022-03-27 at 2 41 11 PM

The most useful feature is that you can click the "crosshair" button and then hover over a certain element in a different app to see its attributes.

While the inspector is nice, it has a few weaknesses:

  • Limited voice control -- it has a couple of keyboard shortcuts but that's it
  • Squats on the alt-space shortcut while running (makes it harder to quickly use).
  • Similarly, if an element is selected it draws a persistent green box around it. Normally this is fine but it makes for observing things long term annoying
  • After using the inspector, you frequently will want to iterate on what you've just inspected using the Talon REPL, but this requires context switch + manually copying information. A first party Talon integration could allow for faster switching.

Thanks to the new ui.element_at() recently added to talon by aegis, we could build a replacement using Canvas. It could serve as a semitransparent sidebar that could be dragged anywhere and toggled on/off as necessary. It could also draw borders around the focused element and/or elements under the mouse.

@phillco phillco added the idea label Mar 27, 2022
@phillco phillco changed the title Rebuild the accessibility inspector in Talon custom accessibility inspector Mar 27, 2022
@nriley
Copy link
Collaborator

nriley commented Jun 30, 2024

#68 implements a simple version of this by outputting information to the log. Still plenty of room for improvement!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants