Deactivate one button for a specific app

How do I remove a button that I have setup globally for a specific app? Thanks!

The easiest way to not configure it globally but for a conditional activation group. Conditional activation groups allow you to define precise conditions. They are added like normal apps:

Here is an example that will be active for all apps but Finder:

Works great. Thank you.