If using the AMDOverdrive for testing the stability for each rise in speed, the testing will likely take you somewhere around half an hour to 40 minutes. When it reaches it's maximum the system will lock up or crash. So make sure to WATCH the applet for Overdrive testing, then subtract .2 from whatever maximum it gives you. Then restart yours system and open the BIOS. On the A10 APUs, I recommend not raising your core voltage by more than 0.125 v. Not really sure of default voltage in the A10, but I think it is roughly 1.280 v, so do not raise your voltage over 1.405 v. Then just adjust your NB Ratio to 110 Mhz and run your mulitplier up to, say 37 x (or 38 x which will give you right around a 4.0 GHz that might get a little warm). Then, as George Phillips says, run Prime 95 for 60-90 minutes to make sure of the settings being stable, and make sure the OC has not done anything to Memory or GPU. Don't try to change any of the GPU settings if you are running your graphics off the APU, it's already done by the CPU OC.
Looking at you rpictures, that AMDOverdrive applet is from a MUCH older version of Catalyst Suite. Make sure to update to THE latest drivers for your system. (I think it might be limited to Catalyst, so get the one that was released in Oct 2015...that is the "Final Product" date before the switch to Crimson Drivers. Good luck and enjoy!