Why you can trust Tom's Hardware
Intel 13th-Gen Raptor Lake Architecture
Intel significantly improved its 'Intel 7' process node by employing faster third-gen SuperFin transistors and increasing the channel mobility (Intel hasn't provided more specifics on the latter). Intel claims this yielded what would typically be considered a full node's worth of performance improvement. As you can see above, Intel shifted and extended the voltage/frequency curve to deliver better performance at both high and low voltages (>50mV reduction at the same frequency, or a 200 MHz increase at the same voltage).
We'll soon see a 6 GHz Raptor Lake model because the improved node performance paired with optimized speed paths within the design (faster, leakier transistors in key paths) allowed Intel to dial up the peak clock rates by 600 MHz. Intel says that Raptor Cove is the fastest core it's ever built, but the node's improved dynamic range can be tuned more for the lower-power end of the V/F curve to improve efficiency for the Raptor Lake mobile chips.
Intel's larger 4MB L2 cache on the e-core clusters also employs a new dynamic prefetching algorithm that uses real-time telemetry data and machine learning to dynamically adjust the prefetch algorithm based on the type of workload it is executing. Intel says this helps improve performance in some types of applications by ~2%, like Adobe Photoshop, After Effects, and Lightroom, and in an unspecified application by up to 16%.
Intel also employs a different dynamic 'Inclusive/non-inclusive' (INI) approach for its L3 cache, but this adjusts between inclusive and non-inclusive caching schemes on the fly. Caches are typically hard-coded to run with either of these policies and can't be changed. As a reminder, inclusive caching keeps a copy of L2 data in the L3 cache and typically improves performance in single-threaded work by providing a faster hit rate for serial workloads, while non-inclusive caching only keeps part of the L2 cache in L3 to improve performance in threaded workloads. Intel's INI uses machine learning and real-time telemetry to make changes to this policy on the fly, thus providing the best of both worlds.
This new feature comes courtesy of a microcontroller unit (MCU) that Intel originally designed into each Alder Lake core, but hadn't yet fully used. Intel was the first to employ a microcontroller built directly into each core, but the controller was only used for SoC-level power management in Alder Lake. With Raptor Lake it now manages power on a per-core basis and provides real-time control of certain characteristics while providing a foundation for new functionalities in the future.
New firmware updates to this microcontroller employ machine learning algorithms that better analyze telemetry data to characterize workloads, thus allowing the MCU to make adjustments to power management, the caching scheme, and prefetch characteristics at a 200-microsecond granularity. The telemetry data is sent from another unit in the core.
Interestingly, the MCU can be further tuned via uploadable firmwares, and such updates could even conceivably be added to Alder and Raptor Lake chips in the field via microcode updates, thus providing a performance upgrade. Intel says there are no firm plans for this option as of yet.
Intel also increased the L2 cache from 1.25MB to 2MB for each Raptor Cove p-core but didn't need to make any significant architectural changes to enable the increased capacity. This cache, and some other features like increased vector compute, were already designed into the edge of the die in the previous-gen Golden Cove architecture, but they were only used for the Sapphire Rapids server processors. Intel's architects can exercise a 'chop option' to remove those features for processors that didn't need them, like Alder Lake.
This approach speeds design and validation while leaving room for future revisions of the same architecture. With Raptor Lake, Intel chose to leave the L2 cache active. This adds roughly 1 cycle of extra latency, a byproduct of having to travel further across the die to access the extra capacity.
Neither the p-cores nor e-cores come with any meaningful IPC increase — we're told the 'one to two percent' increase comes largely from improved memory throughput and higher clock rates. Roughly half of Raptor Lake's frequency improvement stems from the Intel 7 process node's improved capacitance and speed, while the remainder comes from improved instruction timing and fine-grained power optimizations. Intel originally designed the Golden Cove architecture to achieve such speeds, but some headroom was left on the table in order to speed time to market for Alder Lake.
As a result of frequency, memory, cache optimizations, and more threads, Intel claims that Raptor Lake provides 15% more single-threaded performance than Alder Lake and 41% more multi-threaded performance, which was largely borne out in our own testing.
Intel also says that Raptor Lake can provide the same performance as Alder Lake in multi-threaded work at a mere quarter of the power. Yes, you read that right -- Intel says Raptor can match a 241W Alder lake chip, but with only 65W of power. We're putting that to the test; stay tuned. Intel also says it is working on a new dynamic core parking feature for Raptor mobile chips, but the company will share more details later.
Intel’s Core i9, i7, and some i5 models come with the new larger Raptor Lake 8+16 die (8 P-core + 16 E-core). Above, you can see an image of the Raptor Lake die, with the e-cores highlighted in blue. Intel has added two additional quad-core e-core clusters to the die, elongating the die and adding two more ring stops and two more L3 cache slices that are shared among the cores.
As you can see from the unofficial die measurements we have in the table below, the die is also slightly wider. We theorize that the wider dimensions stem from the extra L2 cache placed at the edge of the die. The larger die allows Intel to stay competitive with AMD, but it will also inevitably lead to higher costs. We see that cost passed on to the customer with the Core i5 model, but Intel is obviously absorbing the cost increase of the Core i7 and i9 models.
Row 0 - Cell 0 | Die Area | Die Dimensions | Cores | Process |
Raptor Lake Core i9-13900K | 257 mm^2 | 23.8 x 10.8 mm | 8 P-Cores | 16 E-Cores | Intel 7 |
Alder Lake Core i9-12900K | 208 mm^2 | 20.4 x 10.2 mm | 8 P-Cores | 8 E-Cores | Intel 7 |
Rocket Lake Core i9-11900K | 281 mm^2 | 24 x 11.7 mm | 8 P-Cores | 14nm |
Comet Lake Core i9-10900K | 206 mm^2 | 9.2 x 22.4 mm | 10 P-Cores | 14nm |
Raptor Lake sees significant improvements to DDR5 throughput, but leveraging faster DDR5 memory speeds requires a faster fabric. Intel has increased the ring bus frequency to 5 GHz and it is 900 MHz faster during all-core turbo, addressing a glaring issue we saw with Alder Lake. Intel says the ring bus enhancements alone can result in 5% higher framerates (we've long seen big performance increases from overclocking this setting on Alder Lake, but this will now yield negligible results with Raptor Lake due to the higher native speed).
- MORE: AMD vs Intel
- MORE: Zen 4 Ryzen 7000 All We Know
- MORE: Raptor Lake All We Know
Current page: Intel 13th-Gen Raptor Lake Architecture
Prev Page The Fastest Yet Next Page Intel Core i9-13900K and Core i5-13600K Heat, Overclocking, Benchmark Test SetupPaul Alcorn is the Managing Editor: News and Emerging Tech for Tom's Hardware US. He also writes news and reviews on CPUs, storage, and enterprise hardware.
-
Maebius Great review peeps.Reply
Curious, will you test Raptor Lake with DDR4?
Also, aren't new-gen motherboard prices (for both AMD and Intel), kinda uhm, on the expensive side, even for entry level? -
johnnyboy5520 The Raptor Lake 13900K and AMD 7950X are pretty much equivalent. As for gaming, the 7000 X3d chips will bury Raptor Lake. AMDs mistake was keeping the same core count on the lower end SKUs which allowed Intel an easy win in productivity. Gaming is pretty much game dependent. I don't think AMD will make that same mistake going forward. They've got the superior architecture.Reply -
Why_Me
The B760 boards and locked Intel cpu's are due for release this January.Maebius said:Great review peeps.
Curious, will you test Raptor Lake with DDR4?
Also, aren't new-gen motherboard prices (for both AMD and Intel), kinda uhm, on the expensive side, even for entry level? -
TerryLaze
It wasn't a mistake from AMD, it was all they could do.johnnyboy5520 said:The Raptor Lake 13900K and AMD 7950X are pretty much equivalent. As for gaming, the 7000 X3d chips will bury Raptor Lake. AMDs mistake was keeping the same core count on the lower end SKUs which allowed Intel an easy win in productivity. Gaming is pretty much game dependent. I don't think AMD will make that same mistake going forward. They've got the superior architecture.
There are only so many combinations of their CCX they can do.
To increase their core counts on the lower CPUs they would have to add an CCX to them and come up with a way to add a third CCX to their 7950x.
That would mean that they would lose a big chunk of their margins or increase their prices by that amount, both of these options would be very bad for AMD.
If TSMC comes up with a good node shrink then AMD can increase the amount of cores per CCX for the next round, but then again the amount of cores is already ridiculous and only appeals to a very small amount of people. -
PCWarrior
Not sure how you can claim that AMD has the superior architecture. All the IPC tests show that Raptor Cove P-Cores are ahead of Zen 4 in IPC. Also Intel’s hybrid approach is proving highly effective when it comes to heavily multithreaded workloads. The only thing that AMD has an advantage over Intel is in efficiency but that is only thanks to TSMC N5 (which is a full node ahead of Intel 7) and not due to some AMD microarchitectural design advantage. If anything, the very fact that Intel offers the same or superior performance despite being a full node behind is due to having a better architecture. Much like Nvidia’s RTX 3060 (on Samsung 8nm, an equivalent to a TSMC '10nm') versus Intel’s A770 (on TSMC 6nm).johnnyboy5520 said:The Raptor Lake 13900K and AMD 7950X are pretty much equivalent. As for gaming, the 7000 X3d chips will bury Raptor Lake. AMDs mistake was keeping the same core count on the lower end SKUs which allowed Intel an easy win in productivity. Gaming is pretty much game dependent. I don't think AMD will make that same mistake going forward. They've got the superior architecture. -
The Historical Fidelity Intel artificially hiding L2 cache on the alderlake chips is pretty sus to me. Another reason I am done with Intel. Anti-consumer behavior all day.Reply -
The Historical Fidelity
You are absolutely wrong about efficiency, Zen is a much more power and area efficient architecture. Except for when they decide to go for the highest clock speeds possible on the process node they manufacture on. TSMC’s node designs are notoriously voltage hungry on the top of their operating speeds. Bring down the top speed by 2-300 MHz and the zen 4 7950x sips power at a 105 watt TDP (AMD ECO mode) similar to zen 3 power.PCWarrior said:Not sure how you can claim that AMD has the superior architecture. All the IPC tests show that Raptor Cove P-Cores are ahead of Zen 4 in IPC. Also Intel’s hybrid approach is proving highly effective when it comes to heavily multithreaded workloads. The only thing that AMD has an advantage over Intel is in efficiency but that is only thanks to TSMC N5 (which is a full node ahead of Intel 7) and not due to some AMD microarchitectural design advantage. If anything, the very fact that Intel offers the same or superior performance despite being a full node behind is due to having a better architecture. Much like Nvidia’s RTX 3060 (on Samsung 8nm, an equivalent to a TSMC '10nm') versus Intel’s A770 (on TSMC 6nm). -
TerryLaze
On average the 7950x is about 3% faster in multi, (loses hard on single) and uses 20W less power.The Historical Fidelity said:You are absolutely wrong about efficiency, Zen is a much more power and area efficient architecture. Except for when they decide to go for the highest clock speeds possible on the process node they manufacture on. TSMC’s node designs are notoriously voltage hungry on the top of their operating speeds. Bring down the top speed by 2-300 MHz and the zen 4 7950x sips power at a 105 watt TDP (AMD ECO mode) similar to zen 3 power.
It is more efficient, but much more is hugely hyperbolic, it's so little most people won't even bother to call it a difference.
And you can reduce power draw on the 13900k as well and you only lose performance in a very few applications.You know which ones because all the "trusted reviewers" use exclusively those apps and nothing more.
https://www.pcwelt.de/article/1357334/core-i9-13900k-core-i5-13600k-im-test.html -
The Historical Fidelity TerryLaze said:On average the 7950x is about 3% faster in multi, (loses hard on single) and uses 20W less power.
It is more efficient, but much more is hugely hyperbolic, it's so little most people won't even bother to call it a difference.
And you can reduce power draw on the 13900k as well and you only lose performance in a very few applications.You know which ones because all the "trusted reviewers" use exclusively those apps and nothing more.
https://www.pcwelt.de/article/1357334/core-i9-13900k-core-i5-13600k-im-test.html
That is actually still very high power usage even with MCE off and PL1/2 adherence.
In a thorough review (reference below) of power efficiency we see:
the 7950x at 142 watts beating the 13900k at 142 watts by 13.4% on the combined productivity benching suite graph,
the 7950x at 88 watts beating the 13900k at 88 watts by 14.3% on the combined productivity benching suite graph,
and the 7950x at 65 watts beating the 13900k at 65 watts by 11.7% on the combined productivity benching suite graph.
That’s an average 13.13% better performance efficiency at the same power levels for the 7950x compared to 13900k. That’s a big difference to say the least.
https://tekdeeps.com/energy-efficiency-ryzen-9-7950x-40-over-core-i9-13900k-even-after-tdp-limitation/