Still very much working on it
I realized that to make this different from other AI assistant apps, I need to integrate it deeply into BetterTouchTool and make it really flexible. This turned out to be more complex than I initially expected.
Currently testing a initial version with some friends. It is almost ready for deploying it to all alpha users but a few important changes are still planned for the next few days... I'll post an update here soon.
@Andreas_Hegenberg Can't wait. You could also look at the UI/UX of this app. It's built by the developers who created the Workflows app; Apple required it and it became Shortcuts.
I was just using BTT and was thinking about AI features, good to know you're already working on it! This is what apple intelligence was supposed to be!
the alpha contains the basic building blocks (ai-chat, tools, sub-agents), but I'm gone for the week and will only be able to put everything together next week. I will share a sample setup here.
gemini also works, but the current alphas are not fully ready. I’ll now make everything I have so far available on Monday with the Thaoe release of BTT! Currently working on the docs.
Hi @Andreas_Hegenberg, from your experience, which LLM models produce the highest quality output? I'm also curious if you've found a model that produces surprisingly good output given its relatively lower price compared to more powerful models.
Small UI & UX comment. In Dark mode, some text is difficult to read due to low contrast with the background. Specifically, the purple colored text without any background pill.
Hi @Andreas_Hegenberg , I found a bug for "Window & Display" Tools. From my usage, it appears that any function that accepts an id argument will crash BTT.
I figured out that h@llo.ai will try to execute ai.screenshot_window or ocr_window and always crash.
To show you what I mean, try running this JS, you'll see that it crashes BTT:
//if you rename this, make sure to also rename it in the "function to call" field below.
async function someJavaScriptFunction() {
let windows_array = await ai.get_windows_sorted_front_to_back({numberOfWindows: 20});
let first_window_id = windows_array[0].id;
let screenshot_result = await ai.screenshot_window({id: first_window_id});
return screenshot_result
}
the transparency issue on macOS 15 is already fixed in the latest build.
The screenshot function should now work with 5.634
There will be quite a few updates to this in the coming weeks, I also haven't deployed all of the RAG services with the BTT documentation. Once that is done it will be able to configure most BTT triggers for you.