I have just uploaded v3.519 alpha (get via check for alpha version updates) which logs more details about when / why the preferences window is triggered.
Would be great if somebody could install that alpha and as soon as the issue occurs go to Help => Export Diagnostic Debug Information and send the result to andreas@folivora.ai. That should help me find what's going on.