Those components will fit together, but are not very optimized for each other.
That 2500k can be upgraded to a 3570k for a small bump in price and comes with the typical Ivy benefits (Bit faster, lower power draw, PCI-3).
H61 motherboards are quite old and wont let you overclock (which is why you get a k series CPU), and lack many of the features (SATAIII, USB3, PCI-3, more stuff with 3's on them) of modern motherboards. You want a Z77 motherboard.
Graphics card is pretty good, make sure to get one from a good manufacturer, I suggest Gigabyte, ASUS, MSI or Sapphire.
A 650W power supply should be plenty for your needs. This one is from a good brand and should serve you just fine.
Corsair Enthusiast 650W, 80+ Bronze non-modular. $90http://www.newegg.com/Product/Product.aspx?Item=N82E16817139020