Different Xeon CPU:s in a Dual Socket server

MrAsker

Distinguished
Sep 6, 2011
3
0
18,510
I've got a HP DL 360 G7 which support Dual CPU:s.

I also have one E5630 Xeon CPU (4 cores and 2,53 GHz) and one E5649 Xeon CPU (6 cores and 2,53 GHz). They are afaik I know more or less identical besides the number of cores. Please correct me if this assumption is incorrect.

When I put them in the G7 server and add 2x3x4Gb + 2x3x2Gb the server boots without problems and reports 36GB of memory and 10 cores. So far so good

Adding any combination of extra 2Gb have so many different result from the server not booting to the server boot:ing but only reporting 28Gb or 32Gb of memory.

So, the first question is, should this combination of CPU:s be a problem? I'm looking for getting either an additional E5630 or an E5649 but so far no luck.

The second question is, why does the server report so strange memory values when I add more memory? How does it work when you add 2Gb and loose 4Gb or add 4Gb and loose 8Gb. I see the pattern, but I do not understand the logic.

The third question is, I plan to install W2K13 Std Server and run one virtual SharePoint server and one virtual SQL2012 server on this so what do you think would be better, 2 x E5630 or 1 x E5649? FYI, the server are already in production on a G6 with 36Gb RAM and 1 x E5530 (4 cores and 2,40 GHz). Any ideas?

Thanks in advance!
 

Valentin_N

Honorable
Mar 24, 2013
425
0
10,810
to answer your first and third question, from a finacial stand point go with 2x 22630 but if performance is wanted then go for the mix as they both have the same TDP limit.

Since I don't have a server myself I cant answer the second very well but have you looked what the manual has it say? From the functioning memory setup with a total of 36GB but one cpu of the two has or will have more than the other (one has 24GB and the other 12GB). Do all memories have the same specs?

Here are some tips
Memory issues

Various component solutions
 

MrJohnnyLy

Honorable
Sep 30, 2013
99
0
10,660


Check out the recommended RAM population on Page 37 of the system manual. Although I personally have never mixed CPU's in a dual socket CPU motherboard, it looks like the CPU's are supported.

http://h20195.www2.hp.com/V2/GetPDF.aspx%2Fc02171046.pdf

I'm trying to understand the '2x3x4Gb + 2x3x2Gb,' but i'm drawing a blank haha. Care to elaborate on exactly how many RAM sticks are being populated at what capacity per stick? It looks like this particular system has 18 DIMM slots. Typically it's not recommended to mix different RAM sizes, speed, timing, etc, as it may cause some funky issues with your system.
 

Nikolay Savov

Distinguished
Hi
I agree with MrJohnnyLy - look at the manual - page 37 - memmory config by slots

The key here on HP DL360 G7 is that this is the 3 channel memory platform
18 DIMM SLOTS - 9 per CPU node - 3 channels per CPU - 3 slots per channel
You have to populate the memory slots to CPU 1 as shown in the manual
Population order; start with "A" first, "B" second, "C" third, etc.
and then to "mirror " the slots & size & speed on the CPU2

When you add 2-d CPU it`s advised from HP to have identical CPU`s - so making this work in you case with one 80W CPU and one 40 W CPU is amasing :)

Keep on mind that the CPU`s are supporting diferent Memory speeds - i belive this is the problem you get mixing the memorry ... fail to boot
Intel® Xeon® E5649 (2.53GHz/6-core/12MB/80W, DDR3-1333, HT Turbo 1/1/1/1/2/2) Processor
Intel® Xeon® L5630 (2.13GHz/4-core/12MB/40W, DDR3-1066, HT Turbo 1/1/2/2) Processor
 

MrAsker

Distinguished
Sep 6, 2011
3
0
18,510
Hi,

Sorry for the long delay in answering your feedback, I've just not had time to look at this until today. Anywho, thanks for all the feedback I really appreciate it.

First I want to answer your questions in your replies and comment on your replies.

Valentin: By putting 3 x 4 Gb + 3 x 2Gb per CPU I have the same amount of memory per CPU (18 Gb). All DIMMs have as far as I can see the same specs (voltage, speed, etc ...). I only have a total of 6 pcs of 4Gb DIMMs but I have about 20 pcs of 2 Gb DIMMs so I have ruled out broken DIMMs by testing them all. Yes I have been that thorough.

MrJohnnyLy: I have 2 banks, one per CPU. Each bank have 9 DIMM slots. In Slot 3, 6 and 9 I have the 4 Gb DIMMs and in Slot 2, 5 and 8 I have 2 Gb DIMMs. So 2x3x4 = 2 banks x 3 slots/bank x 4 Gb/slot and 2x3x2 = 2 banks x 3 slots x 2 Gb = 2 x 18 Gb per CPU/bank = 36Gb total.

Nikolay: All DIMMs are for G7 boxes and they are all for boxes with either the E5630 or the E5649 and using only CPU and hence only one bank of slots all DIMMs work as expected. I have put the DIMMS in the right slots in alphabetical order (A to I) and mirrored the order for CPU 2. On the back on of the top cover is a diagram on how to do it so I've followed this to the letter (no pun intended).


If you are interested, these are my sad findings of todays work: With the E5630 + E5649 changing the order of the DIMMs per slot (e.g. put all 4 Gb in slots 2,5,8 and the 2 Gb in slots 1,4,7) did nothing different. Putting only 2Gb DIMMs in all 18 slots just gave me the same 36Gb so I gained nothing but confirming that all 2 Gb DIMMs are working and all 18 slots are working.

I also finally relented and traded the E5649 for another E5630 and still nothing I do makes any difference with the total amount of memory. The best I can get is a total of 36 Gb of memory.


On the bright side I can say that both W2K12 and RH6.2 works like a charm with 1 x E5630 and 1 x E5649. However I still do not trust it to work 100% so I'm going to stick with the 2 x E5630 until I can find a way to get 2 x E5649 or 2 better CPU.


This means that I will not spend any more time on this. I will have to make do with 2 x E5630 and 2 x 18 Gb = 36Gb of Memory. I admit it is a bit frustrating but I can not justify any more time on getting an additional 4-12 Gb of memory. I just don't think it will be worth it.


Thank you for your help. If I do in the future figure this out I will let you know.