Computer doesn't connect to internet on startup

[WackyWormer]

I'm running Vista on my Desktop, and the router is a Gigaset SE567/8 Series.
Whenever I turn my computer on, it will connect to the network, but not to the internet. I get the caution symbol in the task bar with the network icon, and it show the "identifying ( mySSID )". I have to unplug the router for 30 seconds in order to make it work correctly. This router was just installed by my ISP the other day and its been acting this way since then. I've had no issues with it before this. Any suggestions?

 

[WackyWormer]

After using my computer several times over the past few days, I made few observations.
-Sometimes internet connects fine on startup.
-Sometimes, even if I get the caution symbol on the wireless connection icon, after 15 minutes or so, it will disappear and internet will work fine
-No amount of diagnosing, resetting adapters, or renewing IP address fixes the problem
-Even when internet is working, I get random 15-30 second bursts of no internet

Also, I forgot to mention I'm using a Belkin F5D8053 v3 wireless adapter