Since I still Run Vista x64. I think I'll purchase a 50$ ATI card with two DVI slot. To avoid driver conflict.
As far as the resolution being forced to be the same on display #1 #3 and #4. I can always switch to 1920x1080p when I use the TV as display. It will mess up the view on the others but I will only look at one of the 3 display at the same time.
Perhaps I could also use the Catalyst presets to setup my displays. I'm glad I can pull it off tho.
The Matrox card was not the solution at all.