In many cases that's not true. Core i5-2500K is $220 and Radeon HD 6970 is $340.
But ideally you want to buy a CPU to last 4 years and you can get GPU upgrades to keep up with newer games.
I got an i5 2500k at MicroCenter today for 179.99
Not sure it how long it's going, but it's an awesome deal. Even going to the store and paying tax it was less than 200.