That PC should support short graphic card. The board itself however only support PCIe 2.0 x16 i.e equivalent to PCIe 3.0 x8 so performance of high end card may be somewhat limited.
Please take a photo of inside of your case and upload here so that I can see the MB and the PSU.