Power supply - 80 Plus Certified or better from Antec, Corsair(not builder series), Seasonic, Silverstone, or XFX. The OCZ in my profile is also fine for single card rigs. 650 watts would be slight overkill, but will give you a little overhead for future upgrades. 550 watt would be minimum and would depend on the video card selected.
Case - more of a personal preference thing, but basically a mid to full tower with good airflow and at least room for 3 120mm fans. 1 front, 1 rear, 1 top is preferred. Some popular choices are Coolermaster HAF series, Antec 300, similar Thermaltakes, etc...
Hard drives are a bit tougher due to the shortage, but a 500gb Western Digital SATA 6gb/s would be a preferable min. and Blue or Black series.
DVD RW drive or BlueRay - I have found Samsung drives to be excellent.
If you don't need a monitor, then that's over $200 to spend on a case (though it would be unwise to do so because most cases over $130 are outfitted to handle 7+ fans and are therefore made mainly for Overclocking).
Here's a build suggestion. The CPU is capable of overclocking . However if you decide to tinker in the future you will not have any problems.
I assume you will be needing an OS & Monitor . If you have either of these. Consider looking into an SSD like Crucial M4 64GB worth $105