Click using accessibility navigation?

Okay, I had an idea which would be really awesome. So there are features on macs that allow blind people to navigate with just their keyboards (as I understand this) - under voiceover (check out your utility if you’re not sure what I mean). What’s really cool is that it can navigate on almost any program (as long as it’s been made accessible). The idea would be to create a way to somehow get that incorporated. For example shortcat uses labels to go to certain accessible areas (but it seems like the program has died).

My ultimate goal is to try to create something like vimium for mac. Of course, I’m sure there is a lot more work. Does anyone have any ideas on how to get this to work?

I know this isn’t super specific/thought out, but if it does end up working, it would be super useful.

The accessibility API is what Keyboard Maestro uses for accessing buttons and such in the windows.

The primary problem, as always, is in identifying elements in a consistent way.

Makes sense. Any way to do a vimium-like overlay?