I was not getting this dialog a few days ago. I've tested the script as a menu bar action (on my MacBook Pro), and it runs without the dialog.
I am using the test script solely as the simplest case. I have other, more complicated scripts that are not amenable to writing directly in the BTT script input window.
I have gone through all levels of the Privacy and Security settings to see whether I should toggle something, e.g. to give BTT permission to control the test.app application. I cannot find anything. I've also restarted to no avail.
This is an option if you save the script in the editor as an app:
(Show Startup Screen)
PS: I have lots of Applescripts in combination with BTT and so far I haven't had to outsource any as an app. You can also use script libraries, for example.
Unfortunately, making this change does not change the behavior. I still get the dialog box. I changed the script to a different text phrase and I restarted BTT to be sure.
Also, the issue has arisen just recently with script apps that did not have the issue as early as the start of the week. I cannot imagine what I've done in the meantime to cause such an abrupt change. I've not changed any privacy or security settings, nor have I added any other extension.
FWIW, I am running the BTT version from SetApp, and I am coding in Script Debugger.
I deleted the old file and made a new file. The dialog does not appear when I double click from the Finder. The dialog also does not appear when I launch the script app via my MBP menu bar.
Yes, very strange indeed. I am still testing a few other options.
I used tccutil to reset security permissions and rebooted. No luck.
I had the Floating Menu set to appear at the Finder level when I select the SHIFT+CONTROL keys. This worked. After the above reboot, I restarted BTT. I decided to turn off the keystroke toggle. The Floating Menu appears directly when I am at the Finder. In this case, I can launch the Test.app without the confirmation dialog.
My thought is that something in holding SHIFT+CONTROL to show the floating menu causes the script launch to put up the extra dialog. Unfortunately, I now cannot return to a case where I can have the floating menu appear only when I hold the modifier keys. I am apparently not resetting the preferences for the floating menu properly to reset this behavior.
Also, in the meantime, I had quit Keyboard Maestro just to assure that it was not capturing or adding keystrokes to the process. But this seems not to be a concern.
I forgot to say that if you run an applescript holding the Ctrl key, the dialog appears.
So, in the case of a shortcut with control key, the dialog appears, but also running manually any applescript with ctrl key pressed shows the same dialog.
This can be workedaround by using the "Run Apple Script" action with source type "scpt" file. However there was an issue saving / selecting scpt files in the current BTT version. This should be fixed 4.372 alpha /uploading now: