"Find/Search Text on Screen & Move Mouse" does work but it moves the mouse to a specific place

Bugs or Unexpected Behavior
1

I have the following:

[
  {
    "BTTLastUpdatedAt" : 1775124859.790607,
    "BTTTriggerType" : 0,
    "BTTTriggerClass" : "BTTTriggerTypeKeyboardShortcut",
    "BTTUUID" : "5B163C5D-0DE7-4DBE-9764-4FCB0369491F",
    "BTTAdditionalConfiguration" : "1974314",
    "BTTShortcutKeyboardType" : 2302,
    "BTTTriggerOnDown" : 1,
    "BTTNotesInsteadOfDescription" : 1,
    "BTTLayoutIndependentChar" : "r",
    "BTTShortcutKeyCode" : 15,
    "BTTShortcutAdvancedModifierKeys" : "1974314",
    "BTTShortcutModifierKeys" : 1966080,
    "BTTOrder" : 5,
    "BTTAutoAdaptToKeyboardLayout" : 0,
    "BTTActionsToExecute" : [
      {
        "BTTLastUpdatedAt" : 1775124633.8985848,
        "BTTTriggerParentUUID" : "5B163C5D-0DE7-4DBE-9764-4FCB0369491F",
        "BTTIsPureAction" : true,
        "BTTUUID" : "7390947F-3AFF-4624-B323-FBD8633FFEF6",
        "BTTLayoutIndependentActionChar" : "r",
        "BTTShortcutToSend" : "62,56,15",
        "BTTOrder" : 0
      },
      {
        "BTTLastUpdatedAt" : 1775124633.898577,
        "BTTTriggerParentUUID" : "5B163C5D-0DE7-4DBE-9764-4FCB0369491F",
        "BTTIsPureAction" : true,
        "BTTUUID" : "AF54275E-64B7-480F-B88C-02FB39E038A2",
        "BTTPredefinedActionType" : 128,
        "BTTPredefinedActionName" : "Send Shortcut to Specific App",
        "BTTLayoutIndependentActionChar" : "/Applications/Beyond Compare.app",
        "BTTShortcutApp" : "/Applications/Beyond Compare.app",
        "BTTShortcutAppUnderCursor" : "com.ScooterSoftware.BeyondCompare",
        "BTTShortcutToSend" : "62,56,124",
        "BTTEnabled2" : 0,
        "BTTOrder" : 1
      },
      {
        "BTTLastUpdatedAt" : 1775124732.4400492,
        "BTTTriggerParentUUID" : "5B163C5D-0DE7-4DBE-9764-4FCB0369491F",
        "BTTIsPureAction" : true,
        "BTTUUID" : "B59DD5FE-146C-416C-AB9F-9F7489FAE5DE",
        "BTTPredefinedActionType" : 345,
        "BTTPredefinedActionName" : "Pause Execution  or  Delay Next Action (async  or  not blocking)",
        "BTTDelayNextActionBy" : "0.05",
        "BTTOrder" : 2
      },
      {
        "BTTLastUpdatedAt" : 1775124663.6646619,
        "BTTTriggerParentUUID" : "5B163C5D-0DE7-4DBE-9764-4FCB0369491F",
        "BTTIsPureAction" : true,
        "BTTUUID" : "EAC828D7-9BDD-460C-A0CD-C9AE18AE36A7",
        "BTTPredefinedActionType" : 426,
        "BTTPredefinedActionName" : "Find or Search Text on Screen & Move Mouse",
        "BTTGenericActionConfig2" : "{\"BTTFindImageSearchRegion\":0,\"BTTFindTextSearchDirection\":0,\"BTTActionWaitForConditionsInterval\":1,\"BTTActionWaitForConditionsTimeout\":10,\"BTTFindTextMatchMode\":4,\"BTTFindTextContinueActionExecution\":0,\"BTTFindText\":\"Alignment\",\"BTTFindTextRequiredOccurences\":0,\"BTTFindTextMoveMouseTo\":2,\"BTTFindTextSearchOn\":5}",
        "BTTOrder" : 3
      },
      {
        "BTTLastUpdatedAt" : 1775124696.7694821,
        "BTTTriggerParentUUID" : "5B163C5D-0DE7-4DBE-9764-4FCB0369491F",
        "BTTIsPureAction" : true,
        "BTTUUID" : "335C4FEC-98DF-40E7-9D19-6027D99B7D4D",
        "BTTPredefinedActionType" : 421,
        "BTTPredefinedActionName" : "Left Click - Without Modifier Keys",
        "BTTOrder" : 356
      }
    ],
    "BTTGestureNotes" : "Open Rules and go to Alignment tab"
  }
]

My setup is as follows:
I have active and maximized BeyondCompare window on my right monitor, so once I trigger the above it should find the text "Alignment", move the mouse and click, however sometimes it moves the mouse to the top left side, on the left monitor, where there's another app's menu bar and execute the click. I believe that his happens only if "Delay By" (in action "Pause Execution / Delay Next Action (async / not blocking)" ) is > 0.1 . The mouse is always moved in that specific location shown in the screenshot, no matter what text is there, because the mouse is actually moved to the top end of the display, not to the text itself as you can see it is above the "g" in that case:

image
image816×200 54.2 KB

2

Andreas, do you have any ideas on this? Is there some info you are missing?

BTW I've just tested and it doesn't matter if Beyond Compare is on the right display on on the left, behavior is the same.

BTT: 6.343

3

My guess is that in multi-monitor setups where one monitor has retina resolution and another does not and "Search Image On" is set to "Focused Window", the coordinate matching algorithm BTT uses might get confused and choose the wrong screen as reference. Can you check whether 6.344 helps with this? (uploading now)

4

It's still the same. BTW, both displays have the same resolution:

image
image612×1486 111 KB

5

the built-in display is also active, correct? Or are you running in clamshell mode?

6

It is active, this is the arrangement:

image
image610×350 34.5 KB

The strange part is that this is happening super randomly - sometimes 5 out 5 times it is not working as expected, sometimes 3 of 5, sometimes it is 1 of 5, sometime it is working the 1st time then 2 times it is not working then it works again. I'm not doing anything else, like changing windows, triggering other triggers etc. - only triggering that trigger.

7

I have added some specific logs to the next build (will upload in 30min), that should show what is happening. (they will be stored in ~/Library/Application Support/BetterTouchTool/Logs )

8

Here are the logs:
btt_find_text_move_mouse.txt (62.3 KB)

2 times it was not working as expected and one time it worked. Based on the logs I think I've triggered the trigger after 13:39:29:386 (the time when the app changed to Beyond Compare)

BTT: 6.347

9

Ah interesting, the logs show the issue. BTT for some reason didn't receive the correct window id for BeyondCompare and this caused it to use a zero width/height window rect. I think this might be a very subtle timing issue. Can you try again with 6.350? (uploading)

10

Yep, it is working now. Thank you!