It depends on the game, whether it's CPU or GPU limited.
A CPU limited game should show improved performance through overclocking. Amount of improvement will vary by game.
A GPU bound game (high resolution and high quality settings) won't show much, if any, performance gains through overclocking.
An example of GPU limitation using a stock 3.2Ghz and 3.8Ghz OC x4 955: