Yes, but 20W can't make much of a difference. Replacing a 60W light bulb by a 40W will achieve the same.
Nice example. GhislainG is right, the difference in heat production by the CPU itself will be negligible. If the current rig is meeting your computing needs, you might look at solutions to make it run cooler/quieter.
What are the specs for your current server rig?