Is my setup a minor or major bottleneck?

Solution
Minor. And only in certain games. Busy 64 player servers will take a toll on the APU, but that can't be helped. with that platform.