I had this problem too with Vuze. The issue was Vuze was opening too many connections and maxing out my router's connection limit. Each of those routers can only handle 1024 connections. I too am running a WRT54G.http://wiki.vuze.com/w/Bad_routers
Right at the top "Due to (too) many connections"