How to set my app as default on lightpad block?

I’ve built a app using Blocks Code and my lightpad block kept running it even when i switched it off and on.
Now after updating firmware to 0.4.3 when i exit Dashboard of Code the block switches to another app. The app that loads is the same app every time but if i click on different apps in Dashboard several times before exiting it can switch to a another random app and keep on reverting to it from now on.
Is there a way to make my app stay active after i exit Dashboard/Code?