I just upgraded to the 8350 also, so I started looking for similar information with the intent of overclocking in the coming days and weeks. What I found is that the only consistency in the data out there, is its inconsistency. At default settings, with an Antec Kuhler H2O 920, my CPU runs at 20-22C at idle, and around 30C under load. It seems the max recommended temperature to run the chip is around 60-62C, so as long as the chip is staying under that and is stable, you should be fine at whatever speed you can bump it up to.
I read one report of a guy overclocking his to 5.3GHz at 75C and it worked, but I certainly don't recommend getting your chip to temps that high as it will reduce the life of the chip by a TON. 4.8GHz seemed to be a common speed that people were going for with relatively normal cooling setups, although you can find several videos of some extreme water or liquid nitrogen cooling rigs that would probably allow higher.