I've had my router get stuck on some malformed packets causing games to lag.
Replaced it with a router w/firewall that does stateful packet inspection.
Could be the NIC or some auto-updater that's accessing the internet while you play. PCIe gigabit NICs are very cheap these days.
I'll assume you've done a virus/rootkit scan.