Stay away from cases that come with PSUs. They are almost universally of the worst possible quality.
A decent 500W supply should cost nearly as much as that case and PSU combined. The PSU is the last thing you want to skimp on. It might seem like an unimportant component, but that couldn't be farther from the truth.
I would very strongly recommend not buying that case, or any case with a PSU bundled with it.
Case is largely personal preference, though there are real qualitative differences in airflow, ease of assembly, number of drive bays, etc. Too many good ones to list, I'd just recommend hitting Google for case reviews, and look at the very low end. AnandTech also does thorough reviews, both in the high end and low end segments.
As far as a PSU, I'd recommend the Corsair Builder Series units for a low end build. You can get a 500W unit for around $50, maybe a bit less on sale. If the unit costs less than $40, it's usually a very low quality unit.
Cheap PSUs do not last long, and commonly destroy other components in your system when (not if) they fail. Buy cheap and you'll buy twice.