Nope DDR3 RAM will not work.
However DDR3 GPU will work.I couldnot understand your question first.
Get a Geforce 210.
it comes in both Pcix16 and Pci Slots configurations and also cheap.
10$ I think
Since you have DDR2 RAM don't go for very high end cards