For me it's an annoying problem. Every few weeks, I have a client with trouble related to this. Apps restored from backup or merged with a bad installer sometimes have older and newer dylibs from different plugins versions. There are a ton of reasons why people end up with a situation where we have extra dylibs and those cause problems.
Feedback cases 30401 and 2089 ask for improvements in that direction.
If you like to play, we have something for you: A little msgbox plugin will show a msgbox when you drop it into the Frameworks folder of a Xojo made app. This even works for the Xojo IDE itself.
Download test plugin: msgboxplugin.zip