Remove icon from dock after waking up from sleep

When my Mac awakes from sleep BTT shows its icon in the dock and clicking on it opens the configuration window. When I close this window the icon is not shown in the dock any more.

I'd like to have a feature that removes the icon from the taskbar after waking up. I don't want to have to remove it from there manually. Is There already a setting that disables this behaviour? If not, I'd love to have this feature.

Thank you for this nice application!