2018 Macbook Pro ESC key on touchbar

Hi, I have the BTT installed for a while with the latest updates. I am fighting a way to get the ESC key to show up only when I press a sequence of keys. When I VI or write scripts with Iterm. My finger seem to always get the ESC key. Right now I have a x on the left side of the touchbar, sometimes my finger hits it and the darn ESC key shows up, Is there a way to re-hide fast or something better?
Can someone help me with some directions to make this experience better?