Intel professed its love for all things AI at its inaugural AI Day. Intel chose to christen the event with an unexpected announcement that it is already shipping the Purley generation, otherwise known as the Skylake-EP Xeons, to its besties and no one else. The company also announced its new Lake Crest and Knights Crest products. We'll get down in the Purley and AI weeds after the recap.
We've been on a gaming laptop review binge of late, with the ASUS G752VS, the MSI GP62MVR Leopard Pro, and the MSI GT73VR Titan Pro-201 all having made the trip through our extensive testing regimen. If you choose to go the more traditional desktop route, we also have updated our Best CPUs article with the latest deals. We may be on the cusp of Intel's Kaby Lake and AMD's Zen releases, but with Black Friday looming, there are sure to be plenty of deals on the current, or even previous, generation CPUs that will get the job done at a great price.
If desktop PCs and gaming laptops don't provide enough horsepower, perhaps a bleeding-edge multi-billion dollar supercomputer cluster will do the trick. Supercomputing 2106 (SC16) provided plenty of news on the latest and literally the greatest computers on the planet. Even the fastest clusters fall prey to the perils of slow storage, so HPC often uses burst buffers to address the problem. Seagate contends that it can fix its slow HDD storage with some of its fast flash whilst eliminating costly and complex buffers, but if you have to ask how much it costs...well, you know the drill.
Google is lighting up neural networks to improve its translation services of nine languages as it plods its way along to all 103 supported languages. Google may not have the Babel Fish yet, but it's getting there.
The OpenAI group aims to keep the world free from the evils of proprietary AI, some of which may be used for nefarious purposes. The OpenAI nonprofit joined forces with Microsoft's Azure services to leverage the power of its vast phalanx of Nvidia K80 GPUs to train its AI algorithms. Here's hoping OpenAI can stop Skynet before it gains consciousness.
Several companies decided this is the week of the external storage device, so Seagate, ADATA, Plextor and Buffalo all released new products. Speed or capacity, take your pick, but you can't have both. We learned that the Seagate 5TB HDD is actually an SMR device, so it's slow even by HDD standards. For some reason, Seagate continues to avoid labeling its consumer SMR HDDs what they are, which is Shingled Magnetic Recording. Hopefully, it will rectify that soon. The Seagate 5TB HDD takes the capacity crown, while the rest of the smaller, speedy external SSDs run circles around it.
If all of that talk of slow storage has got you down, never fear, Samsung's 960 EVO is here. The M.2 NVMe SSD brings enough speed to set hearts aflutter, such as up to 3.2GB/s of sequential read speed and 380,000 random read IOPS. Unfortunately, there is a profound performance differential between the 250GB and 1TB model. Thank goodness for reviewers. We set the record straight in the Samsung 960 EVO review, and also updated the Best SSDs list just in time for the holidays.
Intel Holds First Artificial Intelligence Day, Breaks Out The Wet Blanket
Intel had a big presence at SC16, as expected, and made a slew of announcements. These included a new and overpriced Xeon E5-2699A (4.8% Linpack gain, 20% price increase), an FPGA-powered Deep learning Inference Accelerator, and word that the Omni Path-infused Knight's Landing models are shipping, which will come in handy as its silicon photonics products evolve.
Intel piggybacked on SC16 with its first Artificial Intelligence Day, or "AI Day" for short, on November 17. The move to interrelated artificial intelligence, machine learning, and deep learning workloads is happening rapidly on devices that range from the smartphone in our hand to the data center. The shift to the new workloads is profound, and Intel predicts that the number of compute cycles dedicated to AI will expand 12x by 2020. Unfortunately for Intel, the normal CPU isn't the preferred platform for AI workloads; ASICs, GPUs, and FPGAs step into these roles quite nicely. Intel has a strategy to compete in all of these segments, which we'll come back to shortly.
Diane Bryant, Executive Vice President and General Manager of Intel's Data Center Group, dropped a bombshell announcement that the company is already shipping Xeon E5 Skylake-EP, also known as the Purley platform, to several undefined customers. Intel is delivering the leading "preliminary production versions" with a targeted feature set to its largest unnamed cloud service providers and HPC customers. The Purley processors won't become available to the public until the middle of 2017, and Bryant noted that all major OEMs are working on full-featured systems that they will release at that time.
We've known for several years that Intel bakes specialized features into the existing Xeon lines for hyperscale customers, such as Facebook, Google, Amazon, Tencent, and Baidu, that Intel doesn't activate in the normal SKUs. Bryant noted that the preliminary Skylake versions come with integrated acceleration advancements, and also spoke about the addition of FPGAs with the processors, which provides lower latency and increases performance. This admission isn't entirely shocking; Intel began displaying working CPU silicon with integrated FPGAs in 2014 and also had Skylake-EP Xeon demos with integrated FPGAs at SC16. We've also seen Purley motherboards in the wild.
Shipping some versions of the pending Xeons to customers in volume ahead of schedule, and on an exclusive basis, raises questions about whether Intel is giving some customers an unfair advantage over others. I think the argument has merit. Google, for instance, announced an enhanced partnership with Intel at the AI Day event, and it likely has access to the new more efficient and faster Purley for its search and cloud services. Theoretically, if Intel then denied that same access to Microsoft, which is a "competitor" to Google with Bing and Azure, you could view that as preferential treatment.
The same theory also holds true with Chinese hyperscalers, such as Baidu and Tencent, which have operations that rival the best the U.S. has to offer. It would raise ethical questions if Intel were to favor one Chinese hyperscaler over another, or even more alarming, perhaps prioritize one region or country over another.
Questions abound over Intel's release strategy, and most of them aren't good. Intel is unquestionably in the position to be a kingmaker, but which king does it make, and should it make one in the first place?
Xeon Phi Knights Mill
At IDF 2016, Bryant pre-announced the Xeon Phi Knights Mill, which is the next iteration of the Knight's Landing platform, but provided very little context.
Intel opened up a bit more at AI Day and claimed that Knights Mill's single- and half-precision support helps power up to 4x the deep learning performance of its predecessor. Knights Mill will be available in 2017.
Intel also noted that Xeon Phi provides direct access to (up to) 400GB of memory, which is a tangible advantage over the current GPU limitation of 16GB. The current Knight's Landing products feature 16GB of on-package MCDRAM (Multi-Channel DRAM) Micron HBM, but we can imagine that Intel will arm future Xeon Phi products (possibly Knight's Mill) with denser 3D XPoint. We already know the company is infusing the second-generation Purley products with 3D Xpoint, so adding it to Xeon Phi products would be a natural progression of the technology.
Intel claimed that Xeon Phi offers a 31x reduction in time to train when scaling to 32 nodes, which is near-linear scaling (a rare feat with any workload). Of course, there are far more parameters, such as power efficiency and cost, that come into play, but scalability is a plus.
And Now...Drumroll Please...Lake Crest And Knights Crest
Intel announced that its first Lake Crest silicon would come to market in the first half of 2017. The Lake Crest accelerator is borne of Intel's Nervana acquisition, and will provide "best in class neural networking performance at launch." Intel didn't provide any further details, though we assume this is the Intel-branded Nervana Engine.
Intel also announced Knights Crest, which merges a bootable Xeon with Intel's "Best-in-class deep learning engine" integrated into one solution. Intel provided no further details, but this could be a merging of a Nervana ASIC and Xeon CPUs. Speculation is sure to abound, but we know Intel has a blended Xeon/FPGA in the hopper. FPGAs are great for rapid re-programmability, but ASICs are more efficient and a Xeon/ASIC combination covers the remainder of the bases.
AI on IA
Intel's "Artificial Intelligence on Intel Architecture" (AI on IA) messaging is indicative of the company's goals. The world of computing, at all levels, is shifting to AI and all of the various components that entails. AI is a rapidly evolving space, so it is best to have a solution to address every aspect, and that includes both hardware and software. This thought obviously isn't lost on Intel.
Intel already has the CPU portion well under control, which goes without saying, but CPUs aren't the primary engine behind most AI workloads. Intel's $16.7 billion Altera acquisition brings FPGAs under its umbrella, while its $400 million Nervana acquisition brings ASICs and software into the equation. Intel also has its Movidius acquisition pending for an undisclosed sum, and it purchased Saffron Technology for an undisclosed sum in October 2015. Intel's roster is set.
Intel faces intense competition from Nvidia, AMD, and IBM, among others, in the vast AI market. The company is clearly lining up its options to keep its stranglehold on the data center alive and well. Intel is also permeating its AI strategy down into the smaller devices on the edge, which meshes very well with its newfound love for everything IoT. One can see the big picture emerging already, and if Intel executes, it's a Mona Lisa for shareholders.
This year's inaugural Intel AI Day was a small affair, but my money says next year's event will be much larger.
