If you are lucky, the PSU will shut down electronically. If you are unlucky, the PSU will quietly die. If you are really unlucky, the PSU can fail catastrophically, like burst into flames or components explode, and take other major components with it.
With major vendors regularly running sales and rebates, if you shop arond long enough, you can find some good deals out there.