Intel Sapphire Rapids 56-Core ES CPU Hits 3.3 GHz at 420W

I'll just quote the article here:

" The Sapphire Rapids-SP processor from YuuKi-AnS is an engineering sample (ES), so don't take the clock speeds seriously. "

Also how many watts should 56 cores running 512 at 3.3ghz burn? That's 7.5w/core or 60w for an 8 core. And does that include the 64Gb HBM2e?

rluker5 said:

I'll just quote the article here:

Also how many watts should 56 cores running 512 at 3.3ghz burn? That's 7.5w/core or 60w for an 8 core. And does that include the 64Gb HBM2e?

We don't know if that is using AVX512 that will cause a 420W TDP. Sure 7.5w/core doesn't sound bad but is 3.3GHz the all core boost or is it something lower. On top of that the 64c Epyc is only 280W TDP or 4.38W/core. That means that SPR is using 70% more power to hit the same clocks. We don't know what Zen 4 will have for TDP but that will be the main competition for SPR and not Zen 3 Epyc.

escksu said:

Power consumption is the main reason why these multicore server cpus have very low clockspeeds...

Depends on the SKU. There are Gen 3 Epyc SKUs (7XF3) that are high clock speed designs that range from 8-32 cores. The 16c variant has a 3.5GHz base and 4.0GHz boost. The 32c has a nice 2.95GHz base and 4GHz boost. There will always be a tradeoff though going more cores. If you need more cores you are going to be sacrificing base clock speed but they are usually able to keep the boost to 3.5GHz+.

pair this with a RTX 3090 and you get a free level 2 charger installed.

sorry, I meant need a level 2 charger

jeremyj_83 said:

We don't know if that is using AVX512 that will cause a 420W TDP. Sure 7.5w/core doesn't sound bad but is 3.3GHz the all core boost or is it something lower. On top of that the 64c Epyc is only 280W TDP or 4.38W/core. That means that SPR is using 70% more power to hit the same clocks. We don't know what Zen 4 will have for TDP but that will be the main competition for SPR and not Zen 3 Epyc.

The latest 64C Epyc (the 7H12) has a max turbo boost of 3.3Ghz. That is however the single thread boost. Not the all-core boost. The other information we have is its base clock which is 2.6Ghz. This is its all-core “boost” under a really heavy all-core AVX2 workload. The TDP of 280W is rated at 2.6GHz under such a heavy workload. Under a lighter SSE all-core workload, it can probably boost a bit higher than base, though definitely below 3.3Ghz and likely 2.8GHz max. This Sapphire Rapids CPU on the other hand has a base clock of 3.3Ghz. The TDP for Intel cpus is defined at base frequency under an extremely intense Intel-defined workload which even though not an AVX-512 workload is much heavier than any AVX2 workload in terms of power consumption. So if we assume that under the same workload the AMD cpu would have to default to its base clock at 280W, then we are talking about AMD 64C@2.6GHz@280W Vs Intel 56C@3.3Ghz@420W.

A far more useful metric than the watts/core is performance per core. Or, if you prefer, watts/core for the same performance per core. With 27% higher frequency we can theoretically have 27% higher performance if IPC were equal. Then comes IPC which is a per workload metric. In workloads like Cinebench R23, Golden Cove cores have a 17-17.5% better IPC than Zen 3 cores. So in that workload we have a total of 48.6% (=1.27x1.17) higher performance per core in that workload. Factoring this we have 5W/core for the same performance, not 7.5. So not so far off from the 4.38W/core of Epyc. Then there are other things to consider like the fact that this is an engineering sample and final silicon will be better. It might as well get down to 4-4.5W/core for the same performance. Zen 4 Epyc will be launching next year. By that point (or within 3-4 months) Intel will be launching SPR's replacement. SPR's delayed launch won't affect (or at least not much) the timeline of its replacement.

PCWarrior said:

The latest 64C Epyc (the 7H12) has a max turbo boost of 3.3Ghz. That is however the single thread boost. Not the all-core boost. The other information we have is its base clock which is 2.6Ghz. This is its all-core “boost” under a really heavy all-core AVX2 workload. The TDP of 280W is rated at 2.6GHz under such a heavy workload. Under a lighter SSE all-core workload, it can probably boost a bit higher than base, though definitely below 3.3Ghz and likely 2.8GHz max. This Sapphire Rapids CPU on the other hand has a base clock of 3.3Ghz. The TDP for Intel cpus is defined at base frequency under an extremely intense Intel-defined workload which even though not an AVX-512 workload is much heavier than any AVX2 workload in terms of power consumption. So if we assume that under the same workload the AMD cpu would have to default to its base clock at 280W, then we are talking about AMD 64C@2.6GHz@280W Vs Intel 56C@3.3Ghz@420W.

A far more useful metric than the watts/core is performance per core. Or, if you prefer, watts/core for the same performance per core. With 27% higher frequency we can theoretically have 27% higher performance if IPC were equal. Then comes IPC which is a per workload metric. In workloads like Cinebench R23, Golden Cove cores have a 17-17.5% better IPC than Zen 3 cores. So in that workload we have a total of 48.6% (=1.27x1.17) higher performance per core in that workload. Factoring this we have 5W/core for the same performance, not 7.5. So not so far off from the 4.38W/core of Epyc. Then there are other things to consider like the fact that this is a an engineering sample so final silicon will be better. It might well get to 4-4.5W/core for the same performance. Zen 4 Epyc will be launching next year. By that point (or within 3-4 months) Intel will be launching SPR's replacement. SPR's delayed launch won't affect (or at least not much) the timeline of its replacement.

Wow there is a lot of wrong information in that post PCWarrior.
The 7H12 is not the latest 64c Epyc. The 7H12 was released in September 2019, is a high frequency CPU, and is a Rome uArch design. Whereas the 7763 is a Milan CPU that was released in March 2021. The 7763 has a 2.45GHz base clock, 3.0GHz all core boost, and a 3.5GHz single core boost.
AMD does not base their TDP around the base clock speed. AMD uses total package power and their server CPUs will top out a 280W regardless of instruction set being used. Intel on the other hand bases their TDP around the base clock speed. This is why we see their CPUs say "120W TDP" but under load will draw 300W and can continue to do that if the Tau is set to infinity.
That SPR engineering sample has a 1.9GHz base clock and a 3.3GHz boost clock. From the article "Thus far, the 56-core part operates with a 1.9 GHz base clock and a 3.3 GHz boost clock. According to the report, the single-core boost clock escalates up to 3.7 GHz."
If that max draw is 420W under AVX-512 then at best the CPU will be running at the base clock of 1.9GHz. Previous versions of Intel CPUs that ran AVX-512 instructions could not run at their base clock with all cores running in AVX-512. It wasn't uncommon to see up to 500MHz reduction in clock speed from the base clock when all cores were running AVX-512. Intel seems to have gotten around some of this clock speed reduction by making the TDP in the PL2 being MUCH higher.
Again the frequency of this SPR engineering sample is only a 1.9GHz base clock. That puts the SPR 29% slower in the frequency which would negate your "17% higher IPC." When normalized for score per GHz in Cineabench R23, the Golden Cove with its best setup (Win 10 + DDR4) is 13% faster than Zen 3 in the single threaded benchmark. Golden Cove @ 2008 = 386.2 per GHz vs Zen 3 @ 1636 = 340.8 per GHz. https://www.anandtech.com/bench/product/2674?vs=2894 That higher performance won't matter if the clock speeds aren't high enough. This is the same reason that Ice Lake Xeon isn't always faster than Cascade Lake Xeon.
SPR has been delayed to Q3 this year. As of January 2022, Zen 4 was scheduled to come out end Q3 or beginning Q4 2022. The odds of Intel releasing Emerald Rapids all of 6ish months after SPR is released almost nil.