Hi There!
Looking for a way to highlight searched text on a screen. Since I use the Find/Search Image & Text and Move Mouse feature on many of my triggers, I know the capabilities are powerful.
I often find myself wasting time looking for a specific word on a screen and would love a universal way to search and highlight text on the screen. Chrome obviously has this feature, as other apps do. But I want something that searches all apps.
Possibly BTT could take a screenshot of the current screen, do a quick OCR search, and then highlight the found word???
Thanks!
Craig
This clearly needs to be combined with stronger AI tools, and the tasks should be broken down like this:
- Press the shortcut key.
- Trigger a full-screen screenshot and save the image as a.jpg.
- Input the search text.
- Communicate the information to the AI model and have it output a full-screen screenshot with annotated text positions or provide the coordinates of the result text.
Right now, AI vision can easily handle this. However, the BTT tool isn't great at integrating AI models. At the moment, I can easily complete steps 1, 2, and 3, but I only receive text responses from the AI, like: "The text you are looking for is in the top left corner."
This is simply because the AI integrated with BTT seems to only respond in text right now.
