Do you have PhysX set to "Auto" in the Nvidia Control Panel? Make sure that you do. Sounds like you have your CPU doing the PhysX. Also make sure you're running the latest 306.23 drivers.
Made sure it was set to my gfx card in control panel. I am running the latest drivers, still having the same issue.