As a test hookup without the router and run tracert on a few servers. Copy down the ping times to each hop.
Reinstall the router and run tracerts again comparing the pings.
If its your router then you will see a 15 to 25 ping increase at the router hop.
Also double check that you have all the ports open and forwarded correctly.