Trigger different actions based on what button started the Gesture Drawing action

Example:
Right mouse button:
Drawing line to the left: go to left space
Drawing line to the right: go to right space

This works perfectly!
Now I would like to:

Mouse Side Button 1:
Drawing line to the left: go to left tab (not space)
Drawing line to the right: go to right tab

So I want to trigger different actions using the same drawing gesture based on the shortcut/mouse button that initiated the drawing.
I think this is currently not possible?

Thanks a lot in advance!