I use Homerow for app control and Vimium-C in Firefox primarily with the Hinting feature. In my ideal world I would code something like this in BTT that can identify points to move the mouse to, click, etc., and then also allow easy finer-control with a numpad. Sometimes I like to sit back with just a wireless keyboard that has a numpad (my optimal position when I’m using AR glasses to put up a bunch of displays), and if I could circumvent those few times a mouse is actually required that would be ideal.
I searched around but maybe not well enough. If someone has already developed something like this that would be nice. Otherwise, what I’m thinking of putting together is (either/or would be fine):
- Jerry-rigging my own “homerow” replacement (because that app is not very versatile right now) that lets me overlay labels to click, right click, or simply move to based on “clickables” and maybe a defined keyword list
- Identify the available displays in a labeled grid for quick jumping
I’m familiar enough with the floating menu option but not any “arbitrary UX objects” workflow in BTT – it looks like I can do something with HTML for instance but that seems… tedious? If there’s a better solution I’m all ears. For the “direct control with the numpad/keyboard keys” option I can do that myself, but in practice it isn’t useful without being able to jump around first.
But forgive my ignorance if this seems obvious. At the very least I’m looking for some pointing in the right direction of:
- What BTT workflows to use to iterate along say, clickables, or a list of on-screen keywords (or like with the menubar clicking options, maybe identify and iterate along all icons)
- What BTT workflows to use for displaying the little small labels that Vimium/Vimium-C and Homerow use, and then typing those labels to click