Intel Puts 10nm Ice Lake CPUs on an M.2 Stick, Meet the Nervana NNP-I Accelerator

15

Intel announced here at its Israeli Development Center (IDC) Day in Haifa, Israel that its Nervana Neural Network Processor for Inference, of NNP-I for short, comes as a modified 10nm Ice Lake processor that will ride on a PCB that slots into an M.2 port (yes, an M.2 port that is normally used for storage). Intel also removed key portions of the Ice Lake processor, like the graphics cores and display blocks, to make room for AI accelerators.

 

Paul Alcorn
Editor-in-Chief

Paul Alcorn is the Editor-in-Chief for Tom's Hardware US. He also writes news and reviews on CPUs, storage, and enterprise hardware.

  • engin33r
    It's not called "NPP-I", it's called NNP-I (i.e. neural network processor - inference)
    Reply
  • TerryLaze
    Holy multicoring Batman!
    Anybody knows how fast or slow m.2/pcie 2 is compared to infinity fabric?
    Not that it matters for AI or DC in general but in case this trickles down to consumer products,now that would be some big little that we could get behind.
    Reply
  • JayNor
    There's a presentation on this Spring Hill NNP-I chip scheduled at Hotchips 31 in August, on day 2. Anandtech has the program listing.
    Reply
  • GetSmart
    TerryLaze said:
    Holy multicoring Batman!
    Anybody knows how fast or slow m.2/pcie 2 is compared to infinity fabric?
    Not that it matters for AI or DC in general but in case this trickles down to consumer products,now that would be some big little that we could get behind.
    Its designed as an add-on A.I accelerator for servers. , Intel used Ice Lake CPUs instead of the usual ARM based CPUs (such as those used in Intel's FPGAs). M.2 slots are common on many motherboards including the mainstream desktop ones. Have you seen any standardized slots for Infinity Fabric?
    Reply
  • TerryLaze
    GetSmart said:
    M.2 slots are common on many motherboards including the mainstream desktop ones. Have you seen any standardized slots for Infinity Fabric?
    How do standardized slots affect any speed or latency?
    I just asked how much slower it would be compared to IF to cross communicate between CPUs through the pci/m.2.
    Reply
  • GetSmart
    TerryLaze said:
    How do standardized slots affect any speed or latency?
    I just asked how much slower it would be compared to IF to cross communicate between CPUs through the pci/m.2.
    The problem is that currently Infinity Fabric is only used by AMD internally for their own chips and can be considered proprietary. The PCI Express used on the M.2 slot is standardized and most common. If you are talking about communications between Intel's Ice Lake CPUs with the NNP-I then that is the fastest (likely thru the ring cache interconnect) because its all internal in a single chip. If you are talking about communications between the server CPU (either Intel Xeon, AMD Opteron or AMD Epyc) with the add-on A.I accelerator module then of course it would be much slower with higher latency and less bandwidth.
    Reply
  • JayNor
    There is an NNP-I article from March 17 on serverhome that describes boards with up to 12 M.2 slots. There is also an article on March 16 that has more info on NNP-L1000 learning chip.
    Reply
  • jimmysmitty
    GetSmart said:
    The problem is that currently Infinity Fabric is only used by AMD internally for their own chips and can be considered proprietary. The PCI Express used on the M.2 slot is standardized and most common. If you are talking about communications between Intel's Ice Lake CPUs with the NNP-I then that is the fastest (likely thru the ring cache interconnect) because its all internal in a single chip. If you are talking about communications between the server CPU (either Intel Xeon, AMD Opteron or AMD Epyc) with the add-on A.I accelerator module then of course it would be much slower with higher latency and less bandwidth.

    Intel has their own interconnect they would use either way, OmniPath.

    This also might be a way to test it out and see how it does first before moving onto their Forevos ideas. I could imagine putting a NNP stacked into a chip would be beneficial.
    Reply
  • TerryLaze
    jimmysmitty said:
    I could imagine putting a NNP stacked into a chip would be beneficial.
    Depends for what.
    NNP is just the modified iGPU to be better at AI so most chips just need these changes to their existing iGPU.
    The additional cores are, I believe, just a by product for them it's just cheaper to use existing full CPUs instead of figuring out how to make an iGPU an external independent thing.
    Reply
  • GetSmart
    jimmysmitty said:
    Intel has their own interconnect they would use either way, OmniPath.

    This also might be a way to test it out and see how it does first before moving onto their Forevos ideas. I could imagine putting a NNP stacked into a chip would be beneficial.
    That OmniPath is usually for server rack-to-rack interconnect (much like Ethernet). However within the chip itself, usually either the ring interconnect or the mesh interconnect would be used.

    TerryLaze said:
    NNP is just the modified iGPU to be better at AI so most chips just need these changes to their existing iGPU.
    The additional cores are, I believe, just a by product for them it's just cheaper to use existing full CPUs instead of figuring out how to make an iGPU an external independent thing.
    That NNP-I is not a modified integrated GPU but rather a dedicated A.I. accelerator architecture. Intel's inclusion of Ice Lake cores removes the need to pay licensing fees for using ARM based cores.
    Reply