You asked a question and basically answered it yourself
No there is no loss of graphical fidelity.
As stated, sli setups are vulnerable to poor scaling, optimization and bugs/errors due to early releases drivers and poor optimization on the developers end.
I have owned 3 sli setups in the past. (1 crossfire). I love running multi gpu setups.
You need to decide whether you have the budget, if it suits your needs, for example, upgrading to a second gtx 970 for a better bang for buck, what resolution you are planning on playing and whether a second gpu will assist you.
Bare in mind, as a rough average 2 out of 10 games will experience non recoverable issues as a result of sli. This means, you will have same or negative performance when running mutli gpu's. These usually aren't ironed out with drivers/game patches. if this is something you know will annoy you, steer clear of multi gpu.
Personally, in regards to VR, I would opt for the single most powerful card I could afford. VR titles are very limited right now and sli headaches could be amplified due to your limit on VR choices.
Facebook
Twitter
Instagram