Open file in finder with Enter key doesn't allow me to accept the "Go To Folder" menu

Hi there, I have a problem with finder. I have remapped the Enter key to Command+O so I can open files with enter key, my problem is that with some dialogs like "Go to Folder" the Enter key doesn't work anymore, what is the best way/practice to solve this issue?
thanks

unfortunately there is no good way to get around that. You should usually use modifier keys in shortcuts to prevent something like this.