if you are 100% sure its not a desktop problem and it does not happen with wireless then i would say its the router.
Just for kicks, by pass the router. plug direct into the modem. restart the modem. Download a large file. If it works then its the router. If it still happens then trouble shoot further.
Most ISP's offer free routers (most). give yours a call and see if they can help you out.