Next time after you switch off the PSU at the rocker-switch or unplug it from the power point, press and hold the computer's start button for 20 seconds to purge the PSU capacitor. Then release it.
Now when you restore power to the PSU again and you press the computer's start button, it should start up straight away.
There is no need to switch off or unplug the PSU everytime after you've finished using your PC, no need at all. just shut down your PC and leave the PSU plugged in and switched on, it's quite safe like that.
You only need to unplug the PSU or switch it off at the rocker switch when you are going to to do some maintenance work or upgrade work inside the case, or you are moving it to another location.