Yes it should fit in your case but it will be in a PCI-E port not a PCI-E 2.0 one, which may limit it, but it is backwards compatible and I doubt it will limit this card.
You will need to upgrade your PSU because yours doesn't have enough power and it is old.
But I wouldn't even consider doing any of these things seeing as the CPU will most likely restrict the GPU in a computer this old.