5 GTX titan Z cards inside x99 deluxe

peaceduke

Honorable
Dec 18, 2014
230
0
10,690
Can I use all 5 slots of my motherboard to put 5 titan z cards? into all of them
if yes then I will use PCI extenders ... if no, why ?
does PCI extenders affect the speed of connection speed of cuda cores ? any restrictions ?

My motherboard :
40-Lane CPU-
5 x PCIe 3.0/2.0 x16 (x16, x16/x16, x16/x16/x8, x8/x8/x16/x8, x8/x8/x8/x8/x8 mode) *1
1 x PCIe 2.0 x4 (max at x4 mode) *2
28-Lane CPU-
3 x PCIe 3.0/2.0 x16 (x16, x16/x8, x8/x8/x8)
2 x PCIe 2.0 x16 (x1 mode)
1 x PCIe 2.0 x4 (max at x4 mode) *2

Overally I want to ask you what do you think about what they said

I conntacted Asus tech support (I am Walter))))
"
Walter

I wanna ask you about x99 deluxe mainboard and its 5 PCI slots
I'm using octane render so it's a gpu based and requires CUDA capability
so I'm thinking about putting video cards into all PCI slots
is there any restrictions ?

Kemar H.
I do understand your query and I would be more than happy to assist.

Walter
Can I ocupy all avaliable slots ? with video cards
all 5

Kemar H.

Due to hardware limitations you would unfortunately not be able to use 5 Graphics card with your motherboard.

Your unit would be able to support 4 Graphics card with the Quad-GPU SLI™ Technology
https://www.asus.com…ards/X99DELUXE/specifications/

Please review the specification listing of your unit.

Walter
I dont want to use sli
I'm using octane render it doesnot require sli
this renderer just takes advantage of all cards installed
I will rephrase my question then

Kemar H.

My apologies but your motherboard would only be able to support 4 Graphics card without bus lane conflicts.

Walter

so it will not even see 5th card ?
One more thing here , I'm planing to use Gtx Titan Z cards so theoretically you can put only 3 cards due to their size
but I'm planing to use pci extender to put more
and as I understand , you recomend to use 40 lane cpu with that configuration .. or 28 lane 5820k will be sufficient ?

Kemar H.

Based on what you are trying to configure would not work with extenders Walter as there would be lane conflcts.

Conflicts*

Walter

there will be conflicts even if I put 4 cards ? not 5
with extenders I mean , 4 cards with extenders
or 3 cards will go into PCI slot as it supposed to be and 1 additional will have extender

Kemar H.

You would not be able to get the 4 cards to run at x16 so if you are able to get them to run at x8 then yes you would be able to use the 4 cards.

Walter

this 16x 8x 4x ... it will affect Cuda core speed ?
or just a data transfer ?

Kemar H.

Both.





 
Solution
Don't forget each Titan Z is 3 slots unless you watercool it. SO really you can only fit 2-3 cards max. I suggest if you have the cash going with a Nvida Tesla Rack. They are very cheap in comparison to all the headache using 5 Gerforce cards will give

Also I would listen to SoNic67. That person is right and you will screw yourself over without the proper system setup. Sounds like to me your trying to get the most bang for you buck like a gaming computer. But really once you pass the consumer world and into the Pro. You cannot skip essentials.

If you want 4 cards for CUDA, you can find used Titan Zs for 1k each. than buy a Single Xeon 12Core and be fine. Just remember you have to get the data out of the computer if you using it as a...

SoNic67

Distinguished
The companies that sell those kind of rendering farms don't use gaming motherboard for a good reason. In order to make use of that rendering power they need usually dual CPU sockets with Xeon Processors to maximize the amount of lanes and match the bandwidth. All in 2U or 4U server format.
http://exxactcorp.com/NVIDIA-Tesla/GPU-Server.php?gclid=CjwKEAjw_7y4BRDykp3Hjqyt_y0SJACome3Tq-Ess4h4LRKU6DnXs-dJgxOlWe4ddrJtffwGI82KMhoCiO3w_wcB
What are you trying to do will not be efficient even with the maximum of four cards.
 

peaceduke

Honorable
Dec 18, 2014
230
0
10,690
lool )) we are talking about CUDA capabilities and octane render
the best gpu renderer in the worls that uses CUDA, not OpenCl

moreover , you're talking about CPU based farms
the prices there is real EVILLLL

one more thing... no one builds 2 socket machine for that use
2 socket motherboard will never substitude farm
as a conclusion: you will spend 10000 for 2 socket PC with lots of ram and you will cut time maximum 2 times
so there is no more useless thing than home farm )))
unless you are an architect who does 30 sec 1min maximum animations
 

iamacow

Admirable
Don't forget each Titan Z is 3 slots unless you watercool it. SO really you can only fit 2-3 cards max. I suggest if you have the cash going with a Nvida Tesla Rack. They are very cheap in comparison to all the headache using 5 Gerforce cards will give

Also I would listen to SoNic67. That person is right and you will screw yourself over without the proper system setup. Sounds like to me your trying to get the most bang for you buck like a gaming computer. But really once you pass the consumer world and into the Pro. You cannot skip essentials.

If you want 4 cards for CUDA, you can find used Titan Zs for 1k each. than buy a Single Xeon 12Core and be fine. Just remember you have to get the data out of the computer if you using it as a farm. That requires a lot of bandwidth depending on what your doing. So 10Gbe fiber out might be necessary. On the other hand you could buy a single Tesla rack, save yourself a ton of headache (possible money too) and have it send to another computer via PCIE connector.
 
Solution