Hello Developer, I haven't used a Mac for about three months because I mainly use Windows for computer entertainment and my new 85-inch TV makes it very comfortable for me to play in bed, so I rarely use the Mac. I see that the last version update was at the end of May. Have no new interesting features been added in the past few months? Thank you
@louishino have you seen this one? does BTT have the equivalent of the very useful Keyboard Maestro "Press Button" actions ? - #17 by Andreas_Hegenberg
Thanks, I haven't noticed this feature yet. Do you use it often? Please give me an example.thanks
Perhaps it will help if you check out this link. Only you know what's new and interesting for you 
currently working on some bigger features (currently testing internally with just a few friends, rollout to alpha users will start next week, stable probably the week after)
1 Like
Ohhh Thank you. I guess it has something to do with AI.
I'm currently working on a BTT project. The general steps are as follows:
- After a hotkey is triggered, the entire screen is frozen as a still frame.
- Then, I use Apple’s built-in OCR to extract the recognized text and its position.
- Next, I call a large language model to translate the recognized texts (in various languages) into English.
- Finally, the translated English text is automatically pasted over the original text positions on the screen.
This way, I aim to implement a feature where a single hotkey can instantly translate the entire screen (or a selected region). I'm also planning to make this command trigger automatically at intervals or based on specific events — I believe this would work really well when reading Japanese manga.
Do you think the current version of BTT can support these features?
@louishino While creating scripting workflows, you may occasionally need to control applications that either do not have AppleScript support or are only partially scriptable. Mac OS X includes built-in support for the control of the computer's graphic user interface via AppleScript.
Graphic User interface (GUI) control is performed by writing scripts incorporating terms and commands from the Processes Suite in the System Events application's scripting dictionary. By addressing the System Events application, AppleScript scripts can select menu items, push buttons, enter text into text fields, and generally control the interfaces of many applications.
The GUI Scripting architecture is based upon the Mac OS X Accessibility Frameworks that provide alternative methods of querying and controlling the interfaces of the OS and applications.
For example, you could automate the process of checking for macOS updates and install them if they're available, i.e. use GUI scripting to open the System Settings app, click on "General", click on "Software Update", wait for available updates to finish loading, once loaded, check if a button is present with the text "Update Now", if yes, then click on it.
GUI scripting is very powerful, but the developer experience is horrible, like eating glass. Understanding a window's UI element hierarchy is not intuitive and determining the correct path of the UI element you want to interact with is very time consuming.
BTT's new "Interact With / Click Specific UI Element" Action makes obtaining the correct path of your desired UI element less painful. Simply click on any UI element on your screen and BTT will automatically obtain its path.
Hope this all makes sense.
These articles go into more detail if you want to learn more:
so i can simply understand that when certain switch buttons or UI appear, we can use certain conditions to automatically trigger them, right?
that's correct.