NO. it is not a battery.
Well, let me rephrase that. Yes, maybe, sort of.
Components, specifically the electrolytic capacitors deteriorate with age. Better caps deteriorate less. PSU calculators tend to be pessimistic when calculating the effects.
But I don't think that there's much to worry about if you are using a good PSU within it's rated limits.