the core i5 2500 and 2500k share almost everything except the unlocked multiplier.
the core 2500 supports vt-d, the 2500k doesn't. the 2500 also supports txt and tpm on b6x and q6x motherboards (for corporate use).
the core i5 2500k can be overclocked by changing the multiplier when used with a pch that allows cpu overclocking i.e. p67 or z68. it should also facilitate ram overclocking using intel xmp.
the core i5 2500 can be overclocked only a few mhz using the turbo multipliers (a z68 motherboard) for single core max turbo. it's multiplier is locked.
the 2500k has hd 3000 igpu with 12 execution units. the 2500 has hd 2000 with 6 eus. both are sufficient for everyday basic tasks like text editing, web browsing, movies etc.
for gaming, a core i5 2500k would be preferable for it's overclockability. people have been able to oc the 2500k from 4.4 to 4.8~5 ghz (it's got 3.7 ghz max single core turbo). some cpu-bound games benefit from the extra clockspeed.
if you get a core i5 2500k, get a good z68 motherboard with decent (dual x8) cfx/sli support. also get a good cpu cooler like coolermaster hyper 212 plus/evo or xigmatek gaia . the cooler will help dissipate extra heat from the cpu when it's overclocked.