Running app is being stopped when starting different build of same app

1. Open an app and configure it to use two different kits.
2. Build and run the app on one kit.
3. Keep this running and select a build configuration of the other kit.
4. Make sure that this build configuration uses a different build directory than the running one.
5. Build the app on the other kit.
   When starting to build, the running app will be stopped.

When the two configurations use separate build directories, it should be possible to run them in parallel.