Double the L1/L2/L3 cache bandwidths, double the cache associativity, two extra instruction issue ports, 24 extra instruction (192 vs 168) in the reordering buffer, improved branch prediction, Fully-Integrated Voltage Regulator (FIVR), significantly improved IGP...
Plenty of fairly significant improvements architecturally-speaking but all of those only yield a ~7% improvement in most current games and applications so not really worth upgrading to if you already have a SB/IB desktop/laptop. The extra complexity and heat from on-chip VRM also make Haswell more difficult to cool and overclock.
Due to double-VRMing and FIVR's relatively low efficiency, Haswell also looks like it will use 10-30W more power than Ivy Bridge under heavy load.