Yep currently the only way would be to create a custom script via generic devices or use some external tool. Generic gamepad support (via Game Controller | Apple Developer Documentation) is on my TODO list for 2026, but I haven't decided on when to work on it yet.
For the PS4 controller users have already posted scripts here on the forum Generic Devices PS4 Dualshock - #10 by CRJ2000