Back when the Conroes first came out, the British magazine, PC Pro, tested a lot of CPU's. They did the best they could to equalize all variables except CPU.
The 2.4 GHz E6600 Conroe was about 60% faster that a P4 EE chip.
The improvement that you get from the greatly improved microarchitecture will more than compensate for the smaller cache.