h@llo.ai - Upcoming AI Features

[fortred2]

Hi @Andreas_Hegenberg , have you experimented with OpenAI's computer-preview tool in their Responses API?

move mouse to a specific ui element

Here's an implementation that uses OpenAI's new computer-use model with their new Responses API – it's pretty cool. See docs here: https://platform.openai.com/docs/guides/tools-computer-use I wrote this script quite quickly so I'll add improvements later... but it works! In this demo, you type in a description of the element on your screen that you want to click on and then using vision AI your computer will automatically click on it. Here's the script: (async () => { let OPENAI_API_KEY =…