Ok so I disabled V-sync through the control panel and there definitely is some improvement. I now get an average of about 75 fps. It did dip a few times to 48 fps but that was the lowest it went. Maximum i got about 96 fps. But even this is with DX 11 and tessellation off. So it would be a good deal lower with them on when it shouldn't be.
EDIT: I also have anti-aliasing at 4x msaa, should that be changed?