How to optimize Hyper-V + RemoteFX For 3D?

Hey guys,

I am living together with a friend and his pc is right across mine (we are in a GbE LAN), the problem is that his pc is utter crap. We want to play some mid/low range games together, but his GPU can not properly handle any of it.
I am running WS2012s and he is running windows 8.
Currently i have set up a VM with Win 8 Enterprise, and have enabled Remote-FX. Everything works, kind of. The only problem is that the mouse acts very weirdly, like it would be constantly accelerated.

Is there somehow i could optimize the performance on hyper-v, or would some other solution would be better altogether?