I was using a wifi adapter plugged directly to the mobo. It got me decent speeds for quite some time, but it suddenly went down from about 20 MB to some speed low enough that I couldn't even load a page to check it. I restarted the modem and then tried with a wired connection and it was fine, so I swapped the Wifi adapter for a USB one and it's giving me good speeds. What could have caused this sudden drop in speed? It was catching the signal fine as well, so it's not a matter of distance or interference.