PSUs only use whatever power they need to maintain output voltages and the amount of power that requires is whatever the loads actually use plus whatever the PSU's losses are.
If you have an old, low-quality no-name brand PSU, its efficiency will likely be in the 50-70% range, meaning the PSU itself wastes nearly as much power as the equipment connected to it uses. In that case, if you are genuinely concerned about efficiency, getting a better PSU would be a good idea... depending on how questionable your existing old PSU is, a new PSU might be a good idea just for safety.
If your CPU uses 40W, your GPU uses 40W and the rest of your components use 20W, your PSU needs to provide 100W. If you have an old no-name PSU with 60% efficiency at 100W, the PSU will draw 167W from the wall. If you upgrade to a 80+ Bronze PSU which will be 82-85% efficient, it will draw about 120W from the wall and you save 45W.