Two different components with issues in the same computer...
The PSU and the motherboard are the common components. Since we don't know the voltages the PSU was sending to the MB, it's pretty much a coin-flip at this point.
There are a lot of considerations moving forward from here.
A bad PSU could damage a new MB and vise-versa . However, I suspect the MB is a more "sensitive" component and would thus take my chances with a new power supply, but you also have a (needed) new video card in the mix. And you don't want to risk damaging the video card with a defective motherboard.
Do you have any "sacrificial" components from old computers you can use for further troubleshooting? Or does your suspect motherboard have on-board graphics you might try?