Those components will fit together, but are not very optimized for each other.
That 2500k can be upgraded to a 3570k for a small bump in price and comes with the typical Ivy benefits (Bit faster, lower power draw, PCI-3).
H61 motherboards are quite old and wont let you overclock (which is why you get a k series CPU), and lack many of the features (SATAIII, USB3, PCI-3, more stuff with 3's on them) of modern motherboards. You want a Z77 motherboard.
Graphics card is pretty good, make sure to get one from a good manufacturer, I suggest Gigabyte, ASUS, MSI or Sapphire.