Once you add a second Finder app to the left Apps menu, you can not delete it from there (in the new UI).