there many causes to this problem, From a router standpoint, if the slowdown is happening in the router, the likely cause is the router having a bloated firmware from the ISP which leaves very little memory for handling many connections.
Many 3rd party firmware and some higher quality routers have a solution to this, they shorten the time a connection is kept depending on the connection type
(some companies may just have a single timer that can be up to a week long for almost all connections and if you do things like p2p, you can easily cause the router to run out of memory and either run extremely slow or not connect to the internet at all)
if the problem is with your router, then check if it has a feature called transparent bridge (this allows you to basically disable the router part of the dsl gateway and use another router like a linksys wrt54gl or any other quality router and then have that router handle the pppoe connection.
if you don't like having 2 networking devices running then get a different dsl gateway. Netgear has some pretty good ones. or if you know anyone who has a service like verizon dsl then maybe they can let you use one of their old modems since verizon generally allows you to upgrade to a new dsl gateway every few years and they don't ask for the old one back.
-==-==-
If the slowdown only happens at a specif time of day then the problem is with the ISP and network congestion and you must call the ISP and get the call escalated to a manager and then to one of their "network specialist" and then have then switch you to a new router on the ISP end that may be less congested.
=-=-=-
if the slowdown happens randomly and when you leave your PC idle, you see a ton of network activity (lights blinking on the router) then you may have something running on your PC thats using a lot of bandwidth, could be a trojan, spyware, or a P2P program running and someone is downloading stuff from your shared folder.
PS if you want to rule out a software problem, then get a ubuntu live cd and surf the internet through ubuntu when the internet is going slow, and if it happens in ubuntu then the problem is either your dsl gateway or ISP
http://www.ubuntu.com/getubuntu/download