I'm not sure if this is possible, but it could be that your ISP is shaping your downloads, but not the reports. That could explain the low rates when downloading. Contact your ISP and find out if they have shaped your account when downloading for some reason.
Also, what are you downloading? Torrents, P2P?