As far as the case, that'll depend what motherboard form-factor you have.
If you've got a Micro-ATX or MiniITX then the Cooler Master N200 would be great - and is very budget friendly
http://pcpartpicker.com/part/cooler-master-case-nse200kkn1
For ATX, I'd suggest you check out the NZXT S340 - Good cable management, good reviews and, again - "budget friendly"
http://pcpartpicker.com/part/nzxt-case-cas340wb1
Without knowing the full spec, it's hard to know the power requirements, but my best guess would be a solid 500W unit as a minimum. Check out the Tier list - anything from Tier 1 or 2.
http://www.tomshardware.com/forum/id-2547993/psu-tier-list.html
You really can't afford to go too cheap on the PSU. I wouldn't recommend anything modular for less than the EVGA SuperNOVA GS 550W at $90 less a $20 rebate, or $80 outright.
http://pcpartpicker.com/part/evga-power-supply-220gs0550v1
If you're willing to go "non modular" to save some cash, the SeaSonic S12II is also a Tier2 unit and can be had for $54
http://pcpartpicker.com/part/seasonic-power-supply-s12ii520bronze
Or the XFX TS 550W for $50 after rebate:
http://pcpartpicker.com/part/xfx-power-supply-xfxts550w