2xTitans and 690 freezing issue

Asiel

Honorable
Aug 27, 2012
47
0
10,530
I'm looking for help with a freezing issue.

I've been running my system just fine with 1 GTX Titan, and 1 GTX 690 (Used for 3D/CAD Apps). SLI for the 690 is disabled in the Nvidia control panel, and the Titan and 690 are not connected to each other via SLI.

Recently I purchased another Titan. (All cards are at stock settings, no overclocking attempted)
First Titan is installed in PCIx16 slot 1
GTX 690 is installed in PCIx8 slot 2
Second Titan is installed in PCIx16 slot 4

The system will now freeze at any given moment. Could be just from browsing the web, or playing a video file.
Once the system freezes, if there is audio playing, it will constantly loop the last fraction of a second of the audio that was playing.
I have no control over the mouse, and the keyboard is unresponsive.
The image stays on the monitor. The image is clear, so there is no visual evidence that the PC has frozen. No lines, weird artifact etc.

Currently I have removed the 1st Titan and the 690, keeping only the new Titan installed in PCIx16 slot 1.
So far no freezing has occurred.

What should I look at to get all 3 cards working in the system?

Thanks for looking.

System Specs:
Win 7 64bit, P9X79 PRO motherboard, 3930k CPU, SeaSonic X-1250 1250W, 2 Titans (not in SLI) 1 690
 

CraigN

Distinguished
Are the Titans SLI'd and using an SLI bridge? Your 3 PCIE lanes run at 16x/16x/8x, so it's possible they are not behaving properly because of the timing inconsistency. I would recommend try running the Titans in SLI in the 16x/16x slots, then having the 690 in the 8x slot and see how that runs.
 

Asiel

Honorable
Aug 27, 2012
47
0
10,530
SLI is off for the 690 (Nvidia control panel), and no SLI bridge or SLI for the Titans.
I did have the Titans on the 16x slots, and the 690 on the 8x pci slot.

I'll try again and see if it works. Could it be the 16xPCI slot? The new Titan runs fine (being the only card installed) in PCIx16 slot 1.

What would be the best way to match the timing?

How about the 3930k CPU, only being PCI-E 2.0 capable vs 3.0? Could that cause issues with all 3 cards installed?
Source : http://forums.guru3d.com/showthread.php?t=375347


System Specs:
Win 7 64bit, P9X79 PRO motherboard, 3930k CPU, SeaSonic X-1250 1250W, 2 Titans (not in SLI) 1 690
 

CraigN

Distinguished


Yeah that's basically what I was trying to figure out..why DO you have 3 individually running cards? SLI the Titans at least.
 

Asiel

Honorable
Aug 27, 2012
47
0
10,530
This rig is for used 3D software. The 3D software is not compatible with SLI..
I would like to have all 3 cards working.

If I do use the SLI bridge for the Titans, and disable SLI in the control panel, should the Titans operate better vs being individually installed? Or will disabling SLI in control panel remove the benifts of SLI?

PSU is : SeaSonic X-1250 1250W

System Specs:
Win 7 64bit, P9X79 PRO motherboard, 3930k CPU, SeaSonic X-1250 1250W, 2 Titans (not in SLI) 1 690
 

Asiel

Honorable
Aug 27, 2012
47
0
10,530
3-Way SLI and Quad-GPU CrossFireX Support.
https://www.asus.com/Motherboards/P9X79_PRO/

I won't be using SLI (it's not for gaming, I need the Cuda cores and ram for renders), it seems to support Quad-GPU with crossfire.

Eventually was looking at getting a quad Titan setup for rendering, but it seems this motherboard won't handle that either...
Do I really need a new motherboard? :(

I'll try moving to slot 3 instead of 4.

System Specs:
Win 7 64bit, P9X79 PRO motherboard, 3930k CPU, SeaSonic X-1250 1250W, 2 Titans (not in SLI) 1 690

 

Asiel

Honorable
Aug 27, 2012
47
0
10,530
I've yet to test out different slots, have some renders working that need to get done first..
Once that is complete I'll do some more testing on different pci slots, hopefully later tonight.
I'll post results.

System Specs:
Win 7 64bit, P9X79 PRO motherboard, 3930k CPU, SeaSonic X-1250 1250W, 2 Titans (not in SLI) 1 690
 

Asiel

Honorable
Aug 27, 2012
47
0
10,530
Following up:
I don't have enough space to put a card into slot 3.
So I have the Titan in slot 1 and slot 4, while the 690 is in slot 2

Currently the system seems pretty stable. Have the 2 Titans connected with 1x SLI bridge. It's been running for about 12hours, and I've had all 3 cards (4 GPUs with 690) at max load for 7 in half hours. No freezing has occurred, the 1x SLI bridge seems to be working better than the 3 way SLI bridge (only the Titans were connected to the 3 way SLI)
Also, I've removed 32 gigs of ram. Using only 1 side of the DIMMs, leaving 32 gigs (had 64gig)
Not sure if both changes have made the system stable, but I'll be testing with 64 gigs soon.

System Specs:
Win 7 64bit, P9X79 PRO motherboard, 3930k CPU, SeaSonic X-1250 1250W, 2 Titans (not in SLI) 1 690, 64gig (32 currently installed)
 

Asiel

Honorable
Aug 27, 2012
47
0
10,530
It seems I couldn't get passed (roughly) 26 hours of stability.
Eventually the system froze.

Hoping new motherboard solves this. Time to start looking for a new one.

 

Asiel

Honorable
Aug 27, 2012
47
0
10,530


This was the case.
Have a Ramapage IV Black Edition and all 3 cards have not caused any stability issues, and to top it off, CPU has been overclocked successfully (was not overclocked on old motherboard).

One more thing to add, no sli bridge used.

Thanks all.

System Specs:
Win 7 64bit, Ramapge IV Black Edition, 3930k CPU (4.2GHZ), SeaSonic X-1250 1250W, 2 Titans (not in SLI) 1 690