Shortcuts accessing through VNC & TeamViewer

I use shortcut keys (for example Cmd+1 = Finder, Cmd+2 = Mail, etc.) on a given Mac. If I connect to that Mac via remote desktop (whichever the terminal, Windows or another Mac), and I press these keys, BetterTouchTool doesn't see them.

It seems that the input from TeamViewer is not seen as a "real keyboard" and therefore not caught by BTT. I wonder if there's a way to get this to work? Currently, without shortcuts, it's not really possible to use a Mac remotely.

Note that apps which define standard shortcuts do work properly (like Spark, i.e. not grabbing the whole input layer).